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CHAPTER  1  -  INTRODUCTION 

The  process  of  quantization  is  ubiquitous  in  the  areas  of  communica¬ 
tions  and  signal  processing  [l],  In  its  most  general  sense,  quantization  is 
a  nonlinear  mapping  of  a  continuous  time,  vector-valued  source  onto  a 
finite  set  of  values.  Many  electrical  engineering  schemes  include  some 
form  of  quantization:  digital  data  communications,  digital  storage,  digital 
filtering,  etc.  From  these  few  examples,  we  see  that  digital  techniques 
involve  quantization,  in  fact,  any  analog-to-digital  conversion  (A/D) 
requires  a  simple  form  of  quantizer.  A  major  goal  in  the  design  of  signal 
quantizers  is  accurate  representation  or  reproduction  of  the  source. 
Quantizers  have  <Uso  been  applied  to  problems  in  detection  and  estima¬ 
tion;  however,  we  will  consider  mainly  their  use  in  Use  direct  signal 
representation  sense. 

In  most  cases  of  interest,  the  source  is  not  deterministic;  hence  a 
statistical  measure  of  performance  is  required.  The  performance  of  the 
device  is  measured  by  some  suitable  functional  of  the  quantizer  itself  and 
of  the  source’s  statistical  properties.  The  most  common  form  of  measure 
is  that  of  mean  r-th  error 

Dr~f\x-  4>(x)|rp(x)  dx 

where  Q(x)  is  the  output  of  the  quantizer  for  an  input  x,  the  exponent  r  is 
some  appropriate  value  usually  greater  than  unity,  p(x)  is  the  source 
density  function  and  the  integral  is  taken  over  the  domain  of  the  source. 
Other  functionals  have  been  suggested  in  place  of  |x-  Q(x)|r  and  are 
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often  amenable  to  the  techniques  considered  in  this  dissertation. 

A  quantizer  is  most  simply  characterized  as  a  set  of  disjoint  regions 
on  the  domain  of  the  source  whose  union  completely  covers  the  space. 
Assigned  to  each  region  is  an  output  value.  The  quantizer’s  operation 
consists  of  deciding  which  region  contains  the  input  value  and  assigning 
to  £(x)  the  associated  output  value.  !n  one  dimension,  the  input  space  is 
the  real  line,  or  some  subset  of  it,  and  the  regions  are  intervals.  This 
zero  memory  quantizer  is  the  simpliest  to  analyze;  much  of  the  previous 
research  into  quantizer  design  involved  solving  for  the  endpoints  of  these 
intervals  and  the  associated  output  points. 

A  useful  model  for  a  zero  memory  quantizer  with  unequal  step  size  is 
the  compandor  system.  This  method  models  the  quantizer  as  a  series 
connection  of  three  elements:  a  compressor  nonlinearity  followed  by  a 
uniform  quantizer  followed  by  an  expandor  nonlinearity.  Any  non- 
uniform  quantizer  can  be  modeled  in  this  fashion  by  appropriately  choos¬ 
ing  the  three  components. 

Signal  quantizers  can  be  separated  into  three  categories:  scalar,  mul¬ 
tidimensional  and  robust  quantizers.  As  mentioned  above,  scalar  quantiz¬ 
ers  have  received  much  attention.  Their  simplicity  is  embodied  in  the 
fact  that  the  regions  (intervals)  are  easily  defined.  For  a  vector  source, 
the  choice  of  quantization  region  is  not  as  obvious;  a  multitude  of  shapes 
and  patterns  will  cover  the  space.  Rate  distortion  theory,  however,  sug¬ 
gests  that  large  increases  in  performance  are  possible  with  block  coding. 
The  previous  research  in  multidimensional  quantizers  includes  the 
analysis  of  asymptotic  performance  rates  of  optimal  quantizers  for  vari- 
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ous  sources  along  with  algorithms  for  their  design.  Unfortunately,  the 
resulting  implementation  is  usually  much  more  complex  than  that  of 
scalar  quantizers.  The  design  of  suboptimal  vector  quantizers  has  also 
been  considered.  These  include  the  use  of  uncorrelating  Alters  and  polar 
coordinates  representation  quantizers. 

Robust  quantizers  are  also  of  interest.  By  robust  we  mean  that  the 
quantizer  performs  well  over  a  class  of  input  sources  rather  than  just  the 
one  it  was  designed  for.  In  fact,  robust  design  often  means  that  some 
minimum  level  of  performance  is  guaranteed  if  the  input  is  of  a  particu¬ 
lar  class  of  sources.  The  source  density  classes  that  have  already 
received  attention  are  those  with  Anite  domain  or  with  moment  con¬ 
straints. 

OUTLINE 

An  outline  of  the  chapters  is  presented  below.  Each  chapter  is  self 
contained  so  that  they  may  be  read  in  any  order. 

Chapter  1  contains  the  above  summaries  of  the  problems  of  data 
quantization  and  this  dissertation  outline.  Following  these  brief  notes,  a 
bibliography  on  data  quantization  is  included.  This  bibliography  is  a 
probe  of  the  available  engineering  and  statistical  literature  and  it  pro¬ 
vides  a  reasonable  starting  point  for  someone  looking  into  the  area  for 
the  Arst  time.  Brief  notes  on  some  of  the  articles  are  provided. 
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The  problem  of  signal  quantizer  design  under  an  incomplete  statisti¬ 
cal  description  of  the  source  is  considered  in  Chapter  2.  Previous 
research  in  this  area  is  reviewed.  For  the  solution  described  in  this 
chapter,  the  statistical  information  assumed  known  is  that  of  a  histogram 
of  the  source  on  a  finite  domain.  The  compandor  model  for  non-uniform 
quantizers  with  a  large  number  of  output  levels  is  employed.  Both 
minimum  mean  and  minimax  error  criteria  are  investigated  leading  to 
the  design  of  piecewise  linear  compressors.  Topics  on  the  partitioning  of 
the  histogram  are  included.  Quantizers  are  designed  accordingly  and 
compared  to  other  designs. 

Chapters  3  and  4  consider  the  quantization  of  multidimensional 
sources.  Several  investigators  [5, 6, 7, 8  have  considered  polar  coordi¬ 
nates  quantization  of  a  bivariate,  circularly  symmetric  source.  Their 
schemes  quantize  the  polar  coordinates  representation  of  the  random 
variables  independently  in  an  attempt  to  reduce  the  mean  square  error 
below  that  of  an  analogous  rectangular  coordinates  quantizer  yet  retain 
an  implementation  simpler  than  that  of  the  optimal  bivariate  quantizer 
Chapter  3  considers  the  design  of  a  spherical  coordinates  quantizer  in  k 
dimensions  with  ifc>2  {k-Z  matches  published  results).  Exact  and  com¬ 
pandor  model  solutions  are  derived  as  is  the  factorization  of  the  quanti¬ 
zation  levels  to  each  quantizer.  Numerical  examples  are  presented  along 
with  asymptotic  results.  Comparisons  to  the  rectangular  (one¬ 
dimensional)  and  optimal  schemes  are  included  for  the  multidimensional 
Gaussian,  Pearson  Type  II  and  Pearson  Type  MI  spherically  symmetric 
sources. 
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In  the  above  mentioned  literature,  it  has  been  shown  that  for  the 
Gaussian  case  the  polar  quantizer  outperforms  the  rectangular  quantizer 
when  the  number  of  levels  N  is  large,  while  for  small  N,  the  rectangular 
form  is  often  better  than  the  polar  form.  Chapter  4  is  an  investigation  of 
the  optimality  of  polar  quantizers  with  the  subsequent  development  of 
optimal  circularly  symmetric  quantizers  (labeled  Dirichlet  polar  quantiz¬ 
ers).  Examples  of  these  Dirichlet  polar  quantizers  for  the  bivariate  Gaus¬ 
sian  source  are  included  and  their  performance  is  compared  to  optimum 
error  rates.  The  topic  of  implementation  is  also  considered. 

Chapter  5  summarizes  the  results  presented  and  suggests  areas  for 

further  research 
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CHAPTER  2  -  HISTOGRAM  QUANTIZERS 


INTRODUCTION 

A  signal  quantizer  is  a  device  which  projects  a  possibly  infinitely- 
valued,  k-dimensional  space  onto  a  finite  set  of  points.  Specification  of  an 
N-level  quantizer  consists  of  partitioning  the  k-space  into  N  disjoint 
regions  St,  i=l,...N,  and  allocating  to  each  region  an  output  point,  y,  In 
the  one  dimensional  case,  the  input  space  is  the  real  line  or  some  subset 
of  it  and  the  N  regions  are  intervals.  Hence,  specifying  the  N+l  interval 
endpoints  and  the  N  output  points  uniquely  determines  the  quantizer. 

In  general,  the  quantizer  output  will  not  equal  the  input  signal,  the 
difference  being  the  quantization  error.  The  design  procedure  should 
reduce  the  effect  of  this  error  by  minimizing  some  suitable  measure  of 
the  distortion  induced  by  the  error.  One  common  criterion  is  mean  r-th 
error 

Dr-  f  I  x~Q{x )  | r p  (x )  dx 

where  j)(x)  is  the  source  probability  density  function  (pdf',  Q(x)  is  the 
quantizer  output  for  the  input  x  and  the  integral  is  taken  over  the  domain 
•f  the  source.  This  error  can  be  rewritten  as 

Dr  -  f  \x-yx 'r  ji(x)  dx  (1) 

t«i  <i 

where  the  *,  are  the  quantizer  breakpoints  (5,  =[*T ,it+1)|  and  the  y,  are 
the  associated  output  points.  Max  [l]  considered  this  distortion  measure 
tor  r=2  and  p(x)  the  Gaussian  density  and  found  necessary  conditions  for 
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the  x,  and  yl  to  minimize  Dz  One  condition,  which  holds  for  most  mean 
error  criteria,  is  that  the  breakpoints  should  be  Dirichlet  partitions  of 
the  output  points 

Zi  =  ^yi-i+2/0  ;  i=2,3,...JV  ,  xj=— ».  xjv+j=» 

This  condition  states  that  the  optimal  quantizer  should  map  each  input 
point  to  the  nearest  output  point.  All  schemes  considered  herein  will 
have  this  property  which  reduces  the  specification  of  an  N-level  quantizer 
to  the  allocation  of  the  N  output  points. 

For  a  large  number  of  levels,  several  authors  [2,3,4]  have  modeled  a 
non-uniform  quantizer  as  a  three  part  system:  a  compressor  nonlinearity 
g,  a  uniform  quantizer  Q<j  and  an  expandor  nonlinearity  y-1  (see  Fig  1) 
The  compressor  function  g  maps  the  domain  of  x  onto  [-1,1]  and  the 
quantizer  Qu  projects  [-1,1]  onto  N  equally  spaced  output  points.  Selec¬ 
tion  of  the  compressor  function  g  determines  the  system  performance 
For  the  mean  r-th  error  criterion,  the  asymptotic  error  {N -*«*>)  for  a 
compressor  g  with  signal  pdf  p  (x )  is 


Dr  »  - - -  f  — dx  (2) 

<r  +  l)A^  L  \g'{x)7 

The  calculus  of  variations  can  be  used  to  find  the  best  compressor 
function  for  the  particular  pdf: 


2/p(y)1/(r+,)dy 

9r(x)  =  -1  +  ~ 


(3) 


f  p( y)1/(r*1)  dy 

For  this  compressor,  the  associated  asymptotic  mean  r-th  distortion  is 


Dr 


1 


2r  A’T  (r  + 1 ) 


V  +  l 


I  Pi*  )l/(r  +  l)  ^ 


(4) 
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ROBUST  QUANTIZERS 

Minimization  ol  this  mean  rth  distortion  measure  requires  exact 
knowledge  of  the  signal  pdf.  Most  of  the  available  literature  on  quantizer 
design  assumes  this  pdf  is  known.  When  the  source  and  quantizer  are  not 
matched,  severe  degradation  can  occur.  For  example.  Fig.  2  presents  the 
MSE  (r=2)  of  several  quantizers  with  A’=16  for  a  Gaussian  input.  The 
quantizers  considered  are  the  optimal  Gaussian,  the  optimal  uniform 
Gaussian  and  the  ^,-law  (see  Examples  section)  quantizers  for  a  unit 
power  source.  The  input  signal  is  allowed  to  range  in  power  from  —30  to 
10  dB .  Both  the  Gaussian  quantizers  show  large  variations  in  SNR.  The 
ji-law  quantizer,  although  relatively  insensitive  to  variations  in  source 
power,  has  substantially  poorer  performance  when  the  source  and  quan¬ 
tizer  are  nearly  matched 

The  performance  of  quantizers  when  the  source  and  quantizer  are 
not  matched  was  considered  in  greater  detail  by  Mauersberger  [5].  He 
evaluated  mean  square  error  rates  for  variance  and  density  shape 
mismatches  of  generalized  Gaussian  density  quantizers.  Suggestions  for 
design  under  this  known  density  functional  form  with  unknown  parame¬ 
ters  were  presented  by  him.  Robust  quantizers,  defined  as  those  that 
perform  well  over  a  range  of  inputs,  are  desirable 

For  the  situation  in  which  the  only  available  statistical  information  is 
that  the  source  has  a  finite  domain  (the  interval  [-c,c]),  Morris  and  Van- 
deLinde  [6]  solved  the  minimax  problem 

min  max  n/_ 
gcQ  pcP  D{P'^ 

where  Q  is  the  set  of  N-level  quantizers,  P  is  the  class  of  density 


zers. 
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functions  on  f-c,c'  and  Dip  ,q)  is  the  distortion  measure  for  density  p  and 
quantizer  q.  They  investigated  mean  error  distortion  measures  and 
characterized  the  worst  case  density  and  the  resulting  minima*  quan¬ 
tizer.  The  worst  case  pdf  consists  of  atoms  located  at  the  quantizer 
breakpoints  (the  points  of  maximum  error)  and  the  minimax  quantizer  is 
a  uniform  (equal  step  size)  quantizer  on  [-c,c].  Bath  and  VandeLinde  [7) 
later  investigated  the  minima*  quantizer  when  the  source  is  unimodal 
and  conforms  to  an  integral  (moment)  constraint.  In  this  case,  the  worst 
case  pdf  is  piecewise  uniform  and  a  numerical  solution  procedure  is 
described. 

The  specific  problem  considered  herein  is  the  design  of  quantizers 
when  the  available  statistical  information  consists  of  a  source  histogram 
An  M-region  histogram  is  characterized  by  the  division  of  the  real  line 
into  M  disjoint  regions  [/ij./^  +  j),  i=l,...M,  and  associating  with  each  region 
the  probability  p,  that  the  source  takes  a  value  in  that  interval  If  p(x)  is 
the  underlying  source  density,  then 

^**♦1 

Px  =  £  p(x)  dx  ;  ■  hM- 

It  will  be  assumed  that  p( i)  has  finite  support  of  [-L.L].  Finite  support 
is  necessary  for  the  histogram  quantizer  design  and  relaxation  of  this 
condition  will  be  mentioned  later.  Without  loss  of  generality,  it  will  be 
assumed  that  the  underlying  density  and  available  histogram  are  sym¬ 
metric  about  zero  The  optimal  compressor  specification  then  reduces  to 
a  function  mapping  [0 ,L]  onto  [0, 1\ 

/ P(y)1/(r*1)  dy 

gT{x)  ~  -L -  ,xc\0,L]  (b) 

f  p[y)U(r^  dy 

0 
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The  compressor  on  [-A,0_  is  defined  odd  symmetrically  The  histogram 
on  [0,1/  has  breakpoints  (M  even) 


0  —  h.  u  <  h  u  < 

f«  f*2 


<  fy/+i  ~  L 


u 

with  the  associated  probabilities  px,  i=—  +  such  that 


u 

2 


Extensions  to  the  non-symmetric  case  are  easily  made. 


QUANTIZER  DESIGN  FROM  A  SOURCE  HISTOGRAM 

Given  an  M-region  histogram  v.ith  regions  [h1,h^  +  1)  and  probabilities 
px .  define  the  region  widths 


Ai  =  f\  +  ]  -  i  =  M 

A  simple  approach  to  the  design  of  the  quantizer  would  be  to  assume  that 
the  density  is  piecewise  constant  of  value  A,  over  the  region  [^.fq+j). 
With  this  assumption,  the  optimal  compressor  characteristic  on  [0,1/ 
from  Eq.(5)  is 

gr(x)  =sjx  +  bj  ;  x  c  [h},hjAr j)  ,  j  =  y-  +  l,..Jl/  (6) 


where  s}  and  b}  are  defined  by 


s;  = 


W 


2  (p,AD1/(r+1) 


j-i 


2  (pAr),/(r+,)  - 


El 


l/(r  +  l) 


M 


I  (pAr)’/(r+,) 


(7) 


(6) 
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This  compressor  is  piecewise  linear  and  asymptotically  has  mean  r-th 


N7,  {r 


I  M 

tttI?i 


(pAr)1/(r*1) 


A  somewhat  more  conservative  approach  would  be  to  consider  a 
minimax-type  problem.  Direct  minimization  of  the  maximum  error  leads 
to  a  uniform  quantizer  on[—  L,L).  Instead,  consider  a  single  histogram 
region  A+i)  Generalizing  Morris  and  VandeLmde's  result,  the  quan¬ 
tizer  on  this  region  should  be  uniform.  On  this  region,  g  {x)  is  linear  and 
the  overall  compressor  is  again  piecewise  linear 

gm(x)  =  cx}x  +  ■  x  £  [hj,hj+]) 

Continuity  of  the  compressor  function  requires  that 

aA-aA 

The  uniform  quantizer  Qr  has  N  equispaced  outputs  on  [  —  1,1" 
Region  j  of  the  histogram,  A+j).  with  width  and  compressor 

slope  Oj,  maps  onto  an  interval  of  width  A,a;  in  [-1,1  \  For  le~ge  A',  the 
number  of  outputs  covered  by  [hj.hj  +  j)  is 

s, 

The  maximum  error  in  Region  j  (since  the  spacing  of  levels  in  [h;,/i;  +  I)  is 
uniform)  is 


d  =  A_-  _i_ 

;  2A;  ~  A  a; 


The  constraint  on  the  a^’s  is 


2  Qx^i  =  1  ;  a,  >  0 


.4*1 
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For  a  general  error  functional  e  (•)  (mo  no  tonic  ally  increasing  in  • 
the  maximum  error  on  Region^  is  e(l/A'aj).  This  error  would  be  due  to 
a  point  mass  located  within  [hj,Aj+1)  with  error  l/A’a,  Since  error 
occurs  in  each  region  where  jd,>0,  taking  a  mean  maximum  error  meas- 
ure  yields 

Du  ~  I!  Pi  e(l/  Nat) 

t  =  l 

Minimizing  this  sum  with  respect  to  the  constraint  gives  the  condition 

a?  Ay  «  Pje'(l/  A'flj) 

For  the  error  measure  e  (•)=  i  •  |r ,  this  condition  simplifies  to 


aj  =  Sj 


for  Sj  as  defined  by  Eq.(7)  Using  this  value  of  a}  yields 

for  bj  from  Eq  (8).  The  resulting  mean  r-th  maximum  error  is 


Du  =  -hr 


U 


I  (plAzr),/(r+1) 


r-t-l 


=  2T(r  +  l)Dr 


(10) 


A- 

Both  the  piecewise  constant  density  approach  and  the  mean  max¬ 
imum  error  method  produce  the  same  solution  when  the  error  functional 
is  r-th  power.  Also,  the  errors  are  proportional 


HISTOGRAM  SELECTION 

If  the  histogram  data  is  not  prespecified,  the  designer  may  have  con¬ 
trol  over  the  allocation  of  the  histogram  regions.  Both  of  the  previously 
considered  error  measures  in  Eqs.(9)  and  (10)  resulted  in  increasing 
functions  of  the  sum 

s  =  I  (pAr)1/(r+,)  (ID 

i=i 
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Boundmg  this  term  will  bound  the  error  Chebychev  type  probability  ine¬ 
qualities  will  be  used  to  provide  upper  bounds  on  the  histogram  region 
probabilities,  the  p/s,  and  the  above  sum  will  be  minimized  over  the 
region  widths,  the  A,’s. 

Consider  the  four  region  histogram  for  a  symmetric  density  on 
[-L.L]  "with  unit  variance.  Denote  the  two  regions  on  [0 ,L]  by  [0,a]  and 
[a, I].  The  Chebychev  inequality  [8]  ( a 2  is  the  source  power) 


Prob(x»jfc)  < 


)£  ;  0<Jfc<CT 

a2/  2k2  ;  o^k 


bounds  the  pl 


p3  =  Prob(O^rso)  <  Prob((Kz)  =  }£ 


Pa  =  Prob (a<x<L)  <  ~~=  ~V 

2a2  2a2 


The  sum  in  Eq.(ll)  is  then  bounded  by  (since  p3=p4,  A3=A4.  Pz-p3 
and  A2=A3/ 


S  <■  2 


1/  (r'*'l) 


+  2 


(■ L-aY 


2a2 


l/(r  +  l) 


and  can  be  minimized  for  ae[0.A].  Optimal  region  placement  is  a  func¬ 
tion  of  the  actual  underlying  distribution  and  hence  does  not  result;  how¬ 
ever,  suboptimal  allocations  do  occur  and  an  understanding  of  region 
placement  develops.  Larger  values  of  M  are  analyzed  in  a  similar 
manner. 

As  more  information  about  the  underlying  density  becomes  known, 
tighter  bounds  on  the  region  probabilities  may  be  found.  For  example, 
for  symmetric,  unimodal  densities,  the  Gauss  inequality  [8] 


Prob(x^fc)  <, 


H(l-fc/er</3)  ;  Os/fcs2a/v/3 
Zo2/  9k2  ,2o/V3<fc 
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may  be  employed  to  solve  for  the  histogram  boundaries. 

Fig.  3  plots  the  resulting  region  placements  for  M- 4,  6  and  8  region 
histograms  using  the  Chebychev  inequality.  The  graphs  indicate  the  loca¬ 
tions  of  the  histogram  breakpoints  for  the  case  r=2.  Notice  that  as  a/  L 
increases,  the  solution  for  Af=8  degenerates  to  the  M- 6  selection.  Simi¬ 
larly,  the  M- 6  lines  collapse  to  the  4  region  case.  The  set  of  permissible 
solutions  ■  •  <hu^L)  is  convex  and  the  degeneration  signifies 

that  the  minimum  is  achieved  on  the  set's  boundary  (one  or  more  of  the 
At  going  to  zero).  For  larger  M,  the  ratio  of  a/ L  must  be  small  to  obtain 
non-zero  A,.  Fig  4  depicts  similar  results  employing  the  Gauss  inequality 
(again  r=2). 
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NUMERICAL  COMPARISONS 


The  following  examples  compare  the  piecewise  linear  compressors  to 
the  optimal  and  ^-law  compressors  under  the  mean  square  error  cri¬ 
terion.  For  the  example  pdf’s,  the  optimal  compressor  is  found  from 
Eq.(3)  with  the  asymptotic  error  given  in  Eq.(4)  The  /u- law  quantizer  has 
compressor  function  on  [0,1]  of 

aJx)  =  Ml+M/LJ 

3,l(  1  ln(l+M) 

with  fx- 255.  This  compressor  is  an  approximation  on  [0.L]  to  the  function 

P*(x)  =  L  +  c  Iog(x/L) 

where  c  is  a  constant.  The  performance  of  g'(')  is  found  from  Eq.(2)  to 
be 

d  *  — 

cHr+DX* 

which  is  truly  robust,  being  totally  independent  of  p(x).  Unfortunately, 
3*(*)  is  undefined  for  x=0;  hence,  the  ^-law  approximation  is  employed 
Substituting  into  Eq  (2)  with  r=2  yields  the  p-law  compressor’s  asymp¬ 
totic  mean  square  error 


a,  „  ifmi+al 


i  +  j  1 1££. 

L  L c 


3/u2A2 

The  comparison  of  performance  for  small  N  (N  =  16)  quantizers  is  also 
tabulated.  The  outputs  are  found  by  an  inverse  mapping  through  the 
compressor  functions  of  eight  equally  spaced  points  in  [0,1].  Dirichlet 
partitions  define  the  quantizer  breakpoints  (the  x,)  and  the  mean  square 
error  is  found  from  Eq  (1). 
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GAUSS1AN  SOURCE:  The  unit  normal  source  is  the  canonical  choice  for 
the  comparison  of  quantization  schemes.  The  pdf  for  xc[—L,L ]  is 

p(  x)  =Ke~*t/z 

with  K  chosen  for  unit  mass  on  [~L,L].  The  optimal  compressor  function 
on  [0.L]  is 

f  e  -ve  /&dy 

9 opt  (z)  =  7 - 

/ e-v'/  6  dy 
o 

The  following  results  are  for  1=5  (5o  loading). 

Piecewise  linear  compressors  for  4,6  and  8  region  histograms  are 
compared  (corresponding  to  2,3  and  4  regions  on  [0,5]).  The  Gauss  ine¬ 
quality  bound  with  a/  L  =  0.2  yields  suboptimal  region  placement  for  M 
equal  to  4  and  6  For  M=8,  equispacing  and  a  modified  Gauss  placement 
are  tabulated.  Figs  5  and  6  display  these  compressor  functions.  Table  I 
lists  the  histogram  region  endpoints  and  the  associated  asymptotic  error 
rates.  The  M=2  quantizer  is  the  uniform  quantizer  on  [-5,5]. 

For  small  N  (N=16),  Table  II  lists  the  positive  output  values  for  Max’s 
optimal,  ^-law  and  piecewise  linear  compressors.  The  piecewise  linear 
examples  are  the  M=4  (Gauss  bound)  and  M=8  (equispaced)  versions 
Values  of  mean  square  error  and  the  associated  Signal-to-Noise  Ratio  are 
tabulated  where 

SNR  =  10  1og10 


t — 


Fig  6  -  Gaussian  source  compressors 
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Table  1  -  Gaussian  source  asymptotic  error  rates 


Max  Opt 

u-law 

4  region 

6  region 

3/i 

0  1284 

0.006122 

0.1855 

0.1517 

3/2 

0.3681 

0.03565 

0.5565 

0  4551 

1/3 

0  09131 

0  9276 

0  7586 

1/4 

0.9424 

0  2022 

1.299 

1.062 

Vs 

1.256 

0  4241 

1  670 

1.433 

V  6 

0.8677 

2.041 

1  913 

V? 

2.069 

1  755 

3  141 

2  393 

_ Va  . . 

2.733 

3  530 

4  3B0 

3  446 

MSE 

0  009513 

0.04096 

0  01452 

0  01090 

20.2 

13  9 

18  4 

19  6 

Table  II  *  N=16  Gaussiar.  source  quantizers 
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LAP LACIAN  SOURCE.  When  modeling  signal  sources,  the  Laplace  source 
on  [-L.L]  is  sometimes  considered 

p(x)  =  K  e-°x 

The  optimal  compressor  on  [0,L]  is 

l_g-eu/3 

9ept(x)  ~  J__e -*L/T 

For  this  pdf,  taking  L=8  and  a=^2  yields  unit  variance.  Again,  the  Gauss 
inequality  bound  yields  suboptima]  region  selection  for  a/ L~ 0  125.  Figs 
7  and  8  depict  the  optimal,  /z-law  and  piecewise  linear  compressors  for 
M=4,6  and  8.  Table  III  Lists  the  histogram  breakpoints  and  the  asymptotic 
error  rates 

Adams  and  Geisler  [9]  tabulated  optimal  output  values  for  the 
Laplace  source  when  N  =  16  and  r=2.  Table  IN’  lists  these  values  along  with 
the  outputs  for  the  /z-law  device  and  the  M=4  and  8  histogram  quantizers 
As  m  the  previous  example,  MSE  and  SNR  are  tabulated  for  each  scheme. 
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Table  III  -  L&placian  source  asymptotic  error  rales 
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Vj 

0  1240 

0  01299 

0  239B 

0  1915 

Vz 

0  4048 

0.05736 

0  7195 

0  5745 

1/3 

0  7287 

0  1461 

1.199 

0  9575 

Va 

1.111 

0  3236 

1  679 

1.341 

1/5 

1.578 

0  6705 

2. 158 

1  724 

1/6 

2.177 

1  360 

2  092 

2  477 

1/7 

3.017 

2.800 

4  935 

3  628 

1/H 

4  431 

5  648 

6  973 

5.810 
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0.0151 

0.0409 

0  0255 

-  .  0  0192 

SNR  (dBl 

17  9 

13  9 

15  9 

_ 

Table  IV-  A'=16  Laplacian  source  quantizers 
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CONCLUSIONS 

Robust  quantizer  design  depends  entirely  upon  the  amount  of  infor¬ 
mation  assumed  about  the  class  of  permissible  input  distributions.  As 
previously  mentioned,  the  uniform  quantizer  is  the  minimax  quantizer 
when  only  finite  support  of  the  density  is  known  and  the  /u,-law  quantizer 
performs  well  for  most  input  statistics.  From  the  examples,  the  pro¬ 
posed  method  of  piecewise  linear  compressor  quantizer  design  is  seen  to 
present  a  viable  alternative  to  uniform  quantization  or  optimal  quantiza¬ 
tion  of  the  "known"  pdf.  A  few  other  points  need  to  be  considered. 

1-  Initially,  the  input  was  assumed  to  have  finite  support  of  [—L,L\ 
Without  this  constraint,  some  of  the  histogram  region  widths,  the  A,, 
would  be  infinite  and  the  resulting  piecewise  linear  compressor  would 
have  sections  of  zero  slope  For  non-finite  support,  select  L  such 
that  the  probability  of  overload  (x  outside  [-L.L])  is  small  and  map 
the  over  load  regions  to  the  nearest  output,  y j  or  yN 

2-  The  use  of  probability  inequalities  in  histogram  region  selection  pro¬ 
vided  degenerate  solutions  for  M> 8  unless  a/ L  approached  zero 
The  results  for  M- 8  from  Table  I  indicate  that  equal  subdivisions  of 
[—L,L]  is  a  reasonable  procedure  for  larger  U .  For  ^  of  order  1/  M , 
the  histogram  converges  uniformly  to  the  underlying  density  [10] 
and  the  piecewise  linear  compressor  converges  to  the  optin  ’ 
compressor. 

3-  The  M  —  1  cusps  of  the  piecewise  linear  compressor  may  seem 
undesirable  Initially,  the  quantizer  breakpoints  were  defined  as  Diri- 
chlet  partitions  of  the  output  points.  On  the  sides  of  a  cusp,  the  two 
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linear  segments  will  in  general  have  different  output  point  spanmg 
and  the  resulting  partition  will  not  lall  exactly  on  the  cusp.  Hence,  a 
slight  rounding  o!  the  cusp  occurs. 

4-  The  simplicity  of  the  compressor  curve  calculation  [Eqs.p)  and  (6), 
suggests  that  this  scheme  may  be  employed  adaptively.  Occasional 
histogram  measurement  would  keep  the  quantizer  tuned  to  a  non- 

stationary  input. 
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CHAPTER  3  -  MULTIDIMENSIONAL  SPHERICAL  COORDINATES  QUANTIZATION 

INTRODUCTION 

A  data  quantizer  is  a  mapping  of  a  vector-valued  source  onto  a  finite 
number  of  points.  A  general  multidimensional  characterization  of  an  N- 
level  quantizer  consists  of  a  partition  of  the  input  space  into  N  disjoint 
regions  and  the  assignment  of  a  particular  output  value  to  each  region 
Implementation  requires  deciding  which  of  the  regions  the  input  is  an 
element  of,  often  a  time  consuming  task.  In  one  dimension,  a  scalar  or 
zero-memory  quantizer  has  regions  which  are  intervals  on  the  real  line, 
hence  its  implementation  is  simple.  Both  uniform  and  non-uniform  inter¬ 
val  width  scalar  quantizers  have  been  designed  for  a  variety  of  fidelity  cri¬ 
teria  and  source  statistics.  The  canonical  example  is  Max's  unit  power, 
Gaussian  probability  density  function  quantizer  [l]  for  the  performance 
criterion  Mean  Square  Error  (MSE).  The  MSE  criterion  has  universal 
appeal  in  its  tractability  and  the  intuitive  notions  of  noise  power  and 
signal-to-noise  ratio.  Rate  distortion  theory,  however,  suggests  that  mul¬ 
tidimensional  quantizers  may  be  more  efficient. 

Research  in  multidimensional  quantization  began  with  the  works  of 
Huang  and  Schultheiss  [2]  and  Zador  [3],  Huang  and  Schultheiss  con¬ 
sidered  the  quantization  of  a  correlated  Gaussian  source.  Their  system 
transformed  the  input  vector  by  a  linear  device  to  a  set  of  uncorrelated 
(hence  independent)  coordinates  and  quantized  each  new  coordinate 
separately.  This  scheme,  although  suboptimal,  retained  a  simple  imple¬ 
mentation  and  reduced  the  MSE  below  that  of  separate  quantizers  for  the 
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correlated  rectangular  coordinates.  The  solution  included  the  factoriza¬ 
tion  of  the  levels  to  each  quantizer  since  the  product  of  the  number  of 
levels  in  each  quantizer  must  equal  the  total  number  of  levels  N.  Zador 
considered  asymptotic  error  rates  for  optimal  multidimensional  quanti¬ 
zation  in  Jfc  dimensions.  He  derived  bounds  on  the  minimally  attainable 
distortion  but  did  not  present  the  actual  quantizer  design.  Later.  Gersho 
[4]  and  Conway  and  Sloane  [5]  discussed  optimal  quantizer  designs  of 
particular  dimensionalities. 

A  major  area  of  interest  in  suboptimal  multidimensional  quantizer 
design  involves  the  use  of  polar  coordinates  (fc=2).  After  effecting  a 
change  from  rectangular  to  polar  coordinates,  the  resulting  magnitude 
and  phase  are  quantized  using  separate  scalar,  Max-type  quantizers  Both 
Pearlman  [6]  and  Bucklew  and  Gallagher  [7]  considered  the  quantizing  of 
an  independent,  bivariate  Gaussian  random  variable  in  this  manner.  DFT 
coefficients,  holographic  data  or  a  pair  of  inputs  from  an  independent  and 
identically  distributed  Gaussian  source  can  be  considered  as  the  output 
of  a  bivariate  Gaussian  source  Published  results  show  that  the  polar 
form  almost  always  outperforms  the  rectangular  format,  a  pair  of  Max 
quantizers,  for  Gaussian  variates.  Bucklew  and  Gallagher  [8]  later 
extended  the  polai  form  to  any  circularly  symmetric  density  of  which  the 
bivariate  Gaussian  is  one  example.  Noting  that  rectangular  quantizers 
outperform  the  polar  quantizers  when  N  is  small,  Wilson  [9’  defined 
unrestricted  polar  quantizers  which  have  lower  MSE  values  Swaszek  and 
Thomas  [10]  investigated  the  optimality  of  the  polar  schemes  and  intro¬ 
duced  a  scheme  which  resembles  the  optimal  quantizer  for  the  bivariate 
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Gaussian  source,  a  tessellation  of  distorted  hexagons,  but  has  a  simpler 
implementation. 

This  chapter  describes  an  extension  of  the  polar  quantizers  men¬ 
tioned  above  to  the  quantization  of  a  k -dimensional  spherically  sym¬ 
metric  random  source.  The  next  section  considers  the  data  vector  x  of 
length  k  with  rectangular  coordinate  elements  xj ,  .  The  source 

statistics  are  contained  m  its  k  -dimensional  density  function  /  (x).  Using 
a  transformation  to  k -dimensional  spherical  coordinates,  the  resulting 
magnitude  and  k—  1  angles  will  be  separately  quantized.  In  the  third  sec¬ 
tion,  the  magnitude  and  angles  quantizers  are  derived  when  MSE  is  the 
performance  criterion.  Asymptotic  results  and  allocation  of  the  number 
of  levels  to  each  separate  quantizer  are  the  topics  addressed  in  the 
fourth  section.  Finally,  we  present  several  examples. 

SPHERICAL  COORDINATES  QUANTIZERS 

Spherically  symmetric  sources  are  characterized  by  contours  of  con¬ 
stant  height  that  are  hyperspheres  in  the  k  dimensional  space  These 
spherically  symmetric  densities  can  be  generated  by  replacing  the 
independent  variable  of  a  zero  mean,  unit  power  univariate  density,  say 
p(x).  with  the  square  root  of  a  quadratic  form  [11].  The  resulting  density 
has  the  form: 

/  (x)  =  7p(Vx^x]  ;  xe  Rfc 

where  7  is  a  scaling  constant  so  that  the  density  has  unit  mass  The 
resulting  multivariate  density,  however,  does  not  m  general  have  as  its 
marginals  the  univariate  p(x) 
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There  is  a  method  of  generating  spherically  symmetric  densities  with 
a  specific  marginal.  Assume  the  marginal  has  characteristic  function 
and  let  the  m-dimensional  characteristic  function  be 

$m(u)=*i[v/ii5u) 

Taking  the  inverse  transform  yields  the  m-dimensional  density  /  (x). 
Care  must  be  taken  to  ensure  that  /  (x)  integrates  to  one  and  is  positive 
for  all  x. 

In  one-dimensional  or  rectangular  quantization,  each  coordinate  Xj  is 
quantized  independently  by  a  Max-type,  scalar  quantizer  Qj .  The  result¬ 
ing  quantization  regions,  being  the  cross  product  of  k  intervals,  are  k - 
dimensional  rectangular  parallelepipeds.  Each  coordinate  has  a  MSE 
term  Ei(Nj)  which  is  the  error  associated  with  a  scalar  quantizer  for  the 
marginal  density  with  Nj  levels  (A^xA’2  xA’fc=AT).  The  errors,  being 
independent  and  orthogonal,  sum  to  the  total  error.  A  symmetry  argu¬ 
ment  shows  that  this  rectangular  quantization  error  is  minimized  when 
each  Nj=Nl/k.  The  total  error  is  then  kxE  1[N'/k) 

Another  set  of  coordinates  with  which  to  describe  an  input  x  of  R*  is 
the  magnitude  r  and  k  —  1  angles  <p;  's  of  the  k  -dimensional  spherical  coor¬ 
dinates  system  [12].  The  following  transformations  produce  these  coordi¬ 
nates. 


k 

1/2 

;  <fj  =  tan"1 

X- 

_ xi±l _ 

•  1 

T72 

1**1 

£>t2 

i  =  l 

The  reverse  transformations  are 

Xj  =  T  COS^*_!  COS^*_2  ■  COS^2  COS?] 
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I z~T  COS^.j  COS^fc_2  '  ■  '  C0S^2  Slll^i 
Xj  =  r  cos^.j  cos^_2  •  cos(fij  sin^_j 
ifc  =  r  siiupt-x 

The  Jfc  =  2  case  has  already  received  much  theoretical  attention  and  is  a 
special  case  of  this  analysis. 

A  change  of  variables  produces  the  source  density  in  spherical  coor¬ 
dinates 

/(*)  -»  /(*•,£)  ~fk(T)  YUM) 

where 

/*(r)  =  ¥(k7zYTk~y  7P (r)  :  r  c 

is  the  magnitude  density  withp(-)  as  defined  above.  The  *-1  angle  densi¬ 
ties  are 

f  i(Vv  =  2^~  ■  c  ^0'2n' 

and 

SMi)  -  rffi2f)r(;/2)  cos,~1*>  >  c  [-71/2,71/2;  ,j  =  2,3, 

The  resulting  spherical  coordinates  are  statistically  independent. 

In  the  spherical  coordinates  representation,  employing  separate 
scalar  quantizers  (Qr.Qi,Qz,-  Qt-i)  defines  the  typical  quantization  region 
as  the  intersection  of  a  non-zero  width  spherical  shell  centered  at  zero 
with  a  pyramid  of  apex  zero  (see  Fig.  1  for  k~2  and  3  examples)  The 
spherical  coordinates  MSE  expression  is  not  as  simple  as  that  of  the 


k  -  3  spherical  quantizer  region  shape- 
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rectangular  quantizer  and  is  derived  below  Another  problem  of  interest 
is  the  factorization  of  the  number  of  levels  to  each  quantizer 
(A  =AV*A'i*A’2  •  xAfc-i)  In  the  bivariate  case  (k=2).  the  ratio  of  Nf  to 

N~  which  minimizes  the  MSE  has  already  been  found  [8], 

For  a  quantizer  with  input  z  and  output  x  the  MSE  D  is 

D  =  f  |x-xj2/(x)dx 

Transforming  to  spherical  coordinates,  letting  hats  mdicate  quantized 
values  and  employing  the  notation  c,  =cos  (pt  and  sl=sin^l,  the  error 
transforms  to 

D-  f  [tz  +  f2  -  2rf  p{r  ,<f)  dr  d.<p  (l) 

pt  ~  ~ 

where  p(r,<f)  is  the  spherical  coordmates  density,  Pfc  is  the  k- 
dimensional  spherical  coordinates  space  and 

-  Sk-lSfc-l+Ct_1Cfc_i[st_2Sfc_2+Cfe_2Cfc_2[sfc>3Sfc_3+  [s  jS  j  +  C  ]C  2" 


The  above  integral  expression  for  D  can  be  simplified.  The  first  two 
terms  in  the  brackets  are  independent  of  <p  and  since  p(r,cp)  factors,  y 
can  be  integrated  out  of  these  terms.  The  last  term  in  the  brackets  is 
the  product  of  an  integral  over  r  and  one  over  .  Eq  (1)  becomes 

mm  m 

D  =  / rz/k(r)dr  +  J  fzJk{r)dr  -ZMk^  f  rrjk{r)dr  (2) 

oo  o 

The  term 


Zr  tr/2 


IT/ 2 


k -1 


Mk-1  -  f  f  ■  ■  f  £(?_.£)  n  d<£_ 

0  — n/2  —n/2  i*l 

is  independent  of  r  and  the  magnitude  quantizer;  thus,  Eq  (2)  can  be 


minimized  over  the  magnitude  quantizer's  parameters  The  three 
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mtegrals  present  in  that  expression  are  all  positive  since  the  magnitude  r 
is  always  positive,  nence,  D  can  also  be  minimized  independently  of  r  by 
maximizing  the  value  of  Mk-i 

Working  sequentially  through  the  ^'s,  the  term  can  be  written 
as 

r/2  a/2 

*4-i  =  f  f  K--i?fc-1+ct-ift-i[s*-2St-2+--  +  •••] 

-it/  2  —»/ 2  1  )  —  — 

it/  2  it/  2 

+  M]  f  ■  ■  ■  f  Cfc.jC*.,  ■  +  (3) 

—ft/  2  —ft/  2 

where  M}  is  defined  sequentially  by  {M o=l) 

Mi  =  f{W2)Y02)  Xz  Sm*3  +  C°S*})  cos>_1^  d?j(4' 

and 

t-i 

F,+i('£)d<f_=  J]  J/tf/d'i f, 
i-j*\ 

The  integrals  in  Eq.(3)  are  independent  of  The  integrand  of  the 

fc-i 

second,  being  non-negative  on  X  [-7t/2,tt/2\  insures  that  the  second 

t=j  +  i 

integral  is  positive,  hence,  maximizing  each  Mj(tfij)  term  over  the  tfj 
quantizer  sequentially  maximizes 

QUANTIZER  OPTIMIZATION 

The  quantizers  designed  in  this  paper  are  all  scalar  processors.  Their 
specification  requires  the  computation  of  the  output  values  and  the  end¬ 
points  of  the  quantization  intervals  For  a  quantizer  Qs{’)  with  Ns  levels 
operating  upon  an  input  s,  adopt  the  notation  s,  as  the  tth  output  value 
and  [s,,sl  +  I)  as  the  ith  interval,  i  =  !,2,...A7s.  with  s,  as  the  ith  breakpoint, 
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i  =  l,2,  ..A’s  +  1.  When  the  number  of  quantization  levels  is  large,  the  com¬ 
pandor  model  of  Bennett  [13]  for  a  nonuniform  quantizer  will  be 
employed  (see  Fig.  2),  Under  this  model,  the  quantizer  Qs  (•'  is  a  three- 
part  system:  an  invertible,  differentiable  compressor  nonlinearity  g  (•) 
mapping  the  range  of  the  input  to  [0,1],  a  uniform  quantizer  Q'j(‘)  with  A’s 
levels  on  [0,1]  and  an  expandor  h.(')=y-1(»)  mapping  [0,l]  back  to  the 
range  oi  the  input  signal  For  this  model,  specification  of  the  compressor 
g(')  and  the  number  of  levels  As  completely  determines  the  quantizer. 

The  minimization  of  D  in  Eq.(2)  [maximization  of  each  in  Eq.(4)[ 
can  be  accomplished  in  two  ways  depending  upon  the  value  of  Ns  When 
As  is  small,  partial  derivatives  with  respect  to  the  quantizer’s  parameters 
will  yield  necessary  conditions  for  the  extremum  similar  to  those  found 
by  Max.  Positive  [negative]  definiteness  of  the  matrix  of  second  partial 
derivatives  evaluated  at  the  stationary  point  demonstrates  the 
sufficiency  of  the  necessary  conditions.  This  may  also  be  shown  using  a 
second  derivative  test  similar  to  Fleischer's  analysis  [14],  These  neces¬ 
sary  conditions  may  be  employed  iteratively,  as  also  suggested  by- 
Fleischer,  to  solve  numerically  for  the  optimal  quantizer's  parameters. 

When  At  is  large,  the  output  of  a  compandor  system  for  an  input  s 
can  be  approximated  by 

s  «a  s  +  eh' [y  (s ) ]  =  s  +  -e  -  - 

9  (s) 

where  e  is  an  independent  noise  source  uniformly  distributed  on 
[-A/2.A/2]  (A  =  1/AS  =  the  step  size  of  the  quantizer  Qi).  After  substi¬ 
tuting  for  s ,  the  calculus  of  variations  may  be  employed  to  yield  the  best 
compressor  function  In  both  cases  (maximizing  or  minimizing  D). 
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the  functional  is  of  the  form 

J"  h[s  ,s  ]  ds 

Employing  the  compandor  approximation,  this  becomes 

f  h[s,g'(s )]  ds 
The  Euler-Lagrange  differential  equation  [15] 

dh  d 
dg  ds 

applied  to  this  problem  yields  the  solution 

dh  .  . 

- — =  constant 

This  expression  is  solved  for  g'  which  is  then  integrated  to  find  the 
optimal  compressor  nonlinearity  The  sign  of  the  second  variation  exhi¬ 
bits  the  sufficiency  of  the  compressor  function  solution 

MAGNITUDE  QUANTIZER 

For  small  Nr,  taking  partial  derivatives  of  D  m  Eq  (2)  with  respect  to 
the  magnitude  quantizer's  parameters  yield- 

rt  =  pT } - (f»-i+f»)  ;  i  =  2,3,...AV,  r,  =  0.  rA. +,  =  »  (5] 

Cir!k_} 

'i*  I 

Mk- 1  f  rfk{r)dr 

f*  =  — r—11 -  ;  i  =  1.2,  ..Ay  (6) 

ri  +  l 

f  /fc(r)dr 
u 

These  expressions,  except  for  the  terms,  are  equivalent  to  the  equa¬ 
tions  defining  the  minimum  MSE  quantizer  derived  by  Max.  His  optimal, 
AV-level  quantizer  is  defined  by 

=  £-(?t-i  +  O  :  i  =  2,3,...Ar,  1 1  =  0.  <AV*,  =  « 
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f  t/k{t)dt 

t  =  Ji -  ;  i  =  1,2  ,...Nr 

M  +  l 

/  fk(t)dt 
k 

From  the  Max  quantizer,  define  a  new  quantizer  with  the  same  break¬ 
points  and  the  outputs  scaled  by 

*■»  =  f  t  ;  Ti=Mk^ 

This  new  quantizer  can  be  shown  to  satisfy  the  necessary  conditions 
imposed  on  the  magnitude  quantizer  by  Eqs.(5)  and  (6).  It  is  shown  in 
Appendix  A  that  and  is  usually  approximately  unity  so  that  the 

scaling  does  not  remove  the  output  points  from  their  respective  regions 
Employing  the  notation  Ek  as  the  unsealed  quantizer's  MSE,  the  spherical 
distortion  can  be  written  as 

D  =  Mk-\  Ek( Ar)  +  k  (1-/42-i) 

Since  the  optimal  magnitude  quantizer  is  a  scaled  version  of  the  Max 
quantizer  for  the  magnitude  density,  for  large  Ar  we  employ  the 
minimum  MSE  compressor  for  the  magnitude  density 

gr(T)  =  Krffkw\t)dt  (7) 

o 

where  Kr  is  a  constant  such  that  gT  maps  to  [0,1].  The  actual  compandor 
system  has  its  expandor  scaled  by  Mk-V  The  same  compressor  function 
results  if  we  directly  apply  the  calculus  of  variations  to  the  minimization 
of  D .  Examples  of  the  magnitude  compressor  function  for  a  multivariate 
Gaussian  source  appear  in  Fig  3  (the  magnitude  random  variable  has  a 
chi  density) 
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MAXIM1ZING  Mj  OVER  THE  ^  QUANTIZER;  j  =  1.2,...fc-l 

When  Nj ,  the  number  of  levels  in  the  j-th  angle  quantizer  is  small, 
partial  derivatives  of  Mj  from  Eq.(4)  with  respect  to  the  angle  quantizer 
Qj's  parameters  and  yield  the  following  necessary  conditions 


-  tan 


-l 


Afy  _]  (cQST?t  —  CQS-^^j) 


(simJi-!  -  sintf,) 


i  =  2,3,... Nj 


(8) 


=  tan  1 


^4*1 

f  cosJ-1iS  siniS  di3 

Ji _ 

^<♦1 

«t~ 1 /  COS,T?  di? 

*4 


i  =  1.2, ...Ay 


(9) 


where  -flj  and  are  the  endpoints  of  the  interval  of  definition  of  <f} 

For  the  first  angle  quantizer,  these  expressions  yield  a  uniform  quantizer 


=  27r(i-l)/Arj  ;  i  =  1,2,... AT, +  1 
$t  =  7t(2i-1)/A'j  ;  i  =  1,2... .AT, 

and  the  resulting  value  of  M  j  is 

„  _  sinCn/A^ 

Ml=  WW) 

The  other  an^le  quantizers  Qj{  ),  jar 2,  are  nonuniform. 

For  large  Ay  we  cannot  immediately  decide  to  employ  the  minimum 
MSE  compressor  for  the  angle  densities  since  we  are  trying  to  maximize 
Mj  in  Eq  (4)  for  each  j ,  not  minimize  the  mean  square  error  between  tpj 
and  tfij •  Assuming  that  A/y_jwl  in  Eq  (4)  for  M}  (since  Ay_3  is  also  large, 
Mj  —j  will  be  close  to  unity),  the  term  in  parenthesis  simplifies  to 
cos(<py—  <Pj).  This  term  is  expanded  in  a  Taylor  series  about  zero,  since 
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for  large  Aj  the  region  widths  will  be  small,  to  give 

cos (Vj-ffj)  »  1 - — 

Now  applying  the  compandor  approximation  and  the  calculus  of  varia¬ 
tions  yields  the  compressor  function  for  the  j-th  angle: 

9j(<Pj)  =  Kj  f  cos^“^/3iJ  di5  (10) 

— n/2 

where  again  Kj  is  a  constant  so  that  gj  maps  to  [0,1], 

This  resulting  compressor  is  seen  to  be  the  minimum  MSE  compres¬ 
sor  for  the  angle  density  and  is  proportional  to  an  incomplete  beta  func¬ 
tion  [16].  For  the  tp^  quantizer,  the  lower  limit  in  Eq.(10)  is  zero,  i (<^i)  is 
linear  and  the  quantizer  is  uniform.  Fig.  4  presents  the  compressor  func¬ 
tions  for  the  second,  third  and  fourth  angle  quantizers.  To  see  if  these 
approximations  are  reasonable  for  small  we  computed  the  parame¬ 
ters  of  the  second  angle  quantizer.  Fig.  5  depicts  the  graph  of  the 
compressor  solution  and  the  actual  values  satisfying  the  necessary  condi¬ 
tions  for  Nz=  16.  We  note  that  the  values  are  very  close. 

The  overall  result  is  that  to  minimize  the  MSE  of  a  k -dimensional 
spherical  coordinates  quantizer,  a  factorization  of  the  total  number  of 
levels  A'  must  be  selected:  A7  =  A'rxAr1  •  ■  For  small  N ,  the  A’r-level 

magnitude  density  quantizer  is  found  by  Eqs.(5)  and  (6),  the  quantizer 
is  uniform  with  A^  levels  and  the  Mj,  j  =2 _ fc  -1,  are  maximized  sequen¬ 

tially,  each  maximization  in  turn  specifying  the  <p}  quantizer  Q}  by  Eqs  (0) 
and  (9)  When  Nj  is  large,  the  factorization  is  still  made  and  the 
compressor  functions  are  computed  from  Eqs  (7)  and  (10) 


ie  se 
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ASYMPT0T1C  RESULTS 

This  section  considers  asymptotic  MSE  rates  and  the  solution  to  the 
problem  of  factoring  the  number  of  levels  N  to  each  of  the  spherical 
coordinates  auantizers.  We  assume  that  the  number  of  levels  in  each 
quantizer  is  large  so  that  the  compandor  approximation  is  appropriate. 
The  levels  are  factored  to  each  quantizer  by 


jV  =  Nr  x  A’]  x  A2  •  •  •  x  Nk- j  =  Nr  x  1 V£ 
where  N ^  is  denoted  as  the  product  of  the  number  of  levels  in  all  of  the 

angle  quantizers.  Previously,  we  developed  the  expression 

MSE  =  M?- 1  (Wt)  x  Ek  (Nr)  +  k  [  1  -  M^  (JV£)  ]  (11) 


hence,  we  require  expressions  for  the  magnitude  error  Ek  as  a  function  of 
Nr  and  for  Mk-\  as  a  function  of  Previous  asymptotic  results  [  l7.’ 
yield  the  Ek  term 


Ek{Nr)  * 


1 


12  Nf 


f  /1/3(r)  dr 


Er_ 

N? 


where  Jk(r)  is  the  magnitude  density. 

It  is  shown  in  Appendix  C  that  Mk-X  is  of  the  form 


*4-i  *  1  " 


ck _ 


hi  Z/{k-D 
/v^ 


where  the  C)  are  defined  sequentially  by 


,2  - 


—  T 


with  Ci~n2/  6  and 


nrr(j+n/2]r3r(j+2)/6'  (?2-  n 

24  f(j/2)  r3[(/+5)/6)  2  Cj-i 


X 


-59- 


This  result  also  yields  the  solution  to  the  factorization  of  the  number  of 
levels  in  the  angle  quantizers 


r0-i)/2 

Nj 

ri  t.l/z 

i*j  +1 

A  second  derivative  test  shows  that  this  factorization  of  Nm  maximizes 


A/fc_!  for  any  spherically  symmetric  density. 


The  compared  quantization  schemes  are  the  rectangular  coordinates 
quantizer  ( k  Max-type  quantizers),  the  above  described  spherical  coordi¬ 
nates  quantizer  and  the  optimal  k -dimensional  quantizer  discussed  by 
Zador.  In  order  to  compare  error  rates  of  schemes  for  different  numbers 
of  dimensions,  we  divide  the  MSE  by  k  yielding  a  MSE  rate  per  dimension 
Since  all  of  the  presented  schemes  have  error  rates  proportional  to 
A' _2/fc,  only  the  coefficient  of  the  rate  will  be  compared.  Rectangular 
quantizers  yield  orthogonal  errors  making  the  coefficient  a  constant, 
independent  of  dimension  The  spherical  coordinates  quantizer's  MSE 
rate  is  found  by  evaluating  Eq  (12)  with  the  appropriate  Er  term  The 
minimally  achievable  MSE  is  presented  by  the  upper  and  lower  bounds 
derived  by  Zador  This  value  is 
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MSE, 


C(k , 


O'! 


Nz/i 


f  pk/(it+2)(x'  dx 

a* 


( k  +2)/k 


where  C(k, 2)  is  a  constant  depending  upon  the  optimal  k  -dimensional 
uniform  quantizer  Zador  provided  bounds  on  this  constant  More 
recently,  Conway  and  Sloane  found  tighter  upper  Limits  on  C{k, 2)  for  k 
between  3  and  10.  Note,  however  that  the  optimal  scheme  requires  the 
implementation  of  the  optimal  A: -dimensional  uniform  quantizer,  usually 
a  vector  input  device,  while  the  rectangular  and  spherical  schemes 
require  only  scalar  processors 

The  first  source  we  consider  is  the  independent  Gaussian  source  with 
probability  density  function 


/(*>  = 


1 


(27tVc/2 

This  source  has  standard  Gaussian  marginals,  hence,  the  results  will  be 
comparable  to  others  in  the  literature.  For  the  three-dimensional  case, 
the  factorization  is  N- A'rxA’jXA*2.  Tables  of  E^(Nr)  and  A/2(jV],At2)  were 
generated.  The  best  combinations  for  the  fc=3  spherical  quantizers  are 
listed  in  Table  I  along  with  their  Signal-to-Noise  Ratio  (SN'R)  rates.  The  per 
dimension  SN'R  is 


SNR  =  10  logl0  —  dB 

For  comparison,  the  one-dimensional  [1]  and  two-dimensional  [6]  results 
are  also  tabulated.  The  values  of  small  N  considered  correspond  to  the 
integers  8  through  18  cubed  which  allow  easy  comparison  to  the  pub¬ 
lished  one  and  two-dimensional  results.  For  large  N ,  several  representa¬ 
tive  values  were  selected  [N=50z  and  1003).  The  values  in  parentheses 
are  the  actual  factorizations  employed  and  in  ail  c^ses  Ar  xA'j xA’2</V 


Table  I  -  Comparison  of  SNR  for  k  - 1,2  and  3  polar  quantizers 
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This  occurs  since  cubes  of  integers  do  not  often  have  suitable  factoriza¬ 
tions  cr  some  of  the  results  for  smaller  N  are  better  For  this  case,  the 
best  allocation  of  levels  to  each  coordinate  quantizer  is 

Nr  »  0  654  Nl/3  ,  N:  »  1.63  Nu3  ,  Nz  »  0  937  N 1/3 
As  A'r-*®,  the  minimum  MSE  quantizer  for  the  chi  density  has  error. 


r, 


F.  =  —  If  fk1/3(r )  dr 


_  3k/z  r3!  (A:  -t-2)/  6~ 

ar(fc/2) 


When  k~3,  this  reduces  to  Er- 1  054  and  the  resulting  asymptotic  Gaus¬ 
sian  source  error  rate  is  7.401  x  A7-273  This  asymptotic  result  compares 
favorably  to  the  above  numerical  results 

For  other  values  of  k,  the  spherical  MSE  rate  is  found  through  Eq.(l2) 
with  Et  as  above  Rectangular  coordinates  Quantizers  have  a  total  error 
rate  of 


HSE^t  *  ~~N-z/k 


The  optimal  rate  for  Gaussian  sources  is 


MSE^  *  C(k  ,2)  2rr 


U+2l 


l  * 


14-fc/Z 


A' 


-Z/k 


Fig  6  and  Table  II  provide  a  comparison  of  the  coefficient  of  the  error 
rate  for  rectangular,  spherical  and  optimal  quantizers  versus  the  number 
of  dimensions  Notice  that  fc=3  yields  the  best  of  the  spherical  error 
rates  and  that  thus  value  is  only  slightly  below  that  of  the  polar  quantiz¬ 
ers 


A 


-  Asymptotic  error  rates  lor  a  Gaussian  source 
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dim 

Rect. 

MSE 

Sph. 

MSE 

Lower 

MSE 

Optimum 

MSE 

Upper 

MSE 

2 

2.72 

2.5665 

2.015 

3 

2.72 

2.467 

1.734 

1.769 

2.609 

4 

2  72 

2.48675 

1.591 

1.624 

2.115 

5 

2  72 

251 

1.5 

1.542 

1.863 

i  6 

2.72 

2.53 

1  436 

1.475 

1  70833 

7 

2.72 

2.54714 

1.388 

1.425 

1.60571 

8 

272 

2.56125 

1 .35125 

1.375 

1.53125 

9 

2.72 

2.57444 

1.32111 

1  42111 

1.47333 

10 

2  72 

2.586 

1.296 

1.401 

1.428 

11 

2  72 

2 59545 

1.27636 

1  39182 

12 

2  72 

2.60333 

1.25833 

1.36167 

13 

2  72 

2  61077 

1  24308 

1  33615 

I  14 

2  72 

2.61714 

1  23 

1.315 

!  15 

2  72 

2  62267 

1.218 

1.296 

!  16 

2  72 

2.62812 

1.20697 

1  27875 

1  i7 

2  72 

2  63294 

1.29824 

1.26412 

1  18 

2  72 

2.63722 

1.18889 

1.25111 

1  19 

2  72 

2  64105 

1  182  1 

1.24 

i  20 

2  72 

2.6445 

1  175 

1,229 

{  21 

2  72 

2.64762 

1.1661 

1.22 

22 

2  72 

2.65045 

1.16182 

1.2109! 

J  23 

2.72 

2.65304 

1  15696 

1  20304 

1  24 

2  72 

2.65583 

1.15206 

1.19583 

2-:. 

2  72 

2  658 

1  1472 

1  1892 

Table  II  -  Asymptotic  results  for  a  Gaussian  source 
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Anolher  spherically  symmetric  source  is  the  Pearson  Type  II  source 


t  =  r(^l)  f  2(v+\)  -xTx'"-k/2 
'  itk/i  2T(v+l)vr(v  +1  -Jfc/2) 


xrx<  2(i/+ 1) 


This  source  has  finite  range  and  a  Pearson  II  marginal  density  with 


parameter  v  (t/>0).  Results  for  this  source  are  not  presented  because  the 


two  dimensional  case  performed  best  in  all  of  the  examples  attempted 
(polar  results  can  be  found  in  [8]). 


Another  source  with  infinite  range  is  the  Pearson  Type  VII  source  with 
Pearson  VII  marginals  (u>l): 


/(*)  = 


2*  (u~\)vT(v+k/2) 


nk/2T(u)  [  2(i/— l)  +  xV^*'2 
For  this  density,  the  rectangular  error  (for  a  bank  of  Max  quantizers)  is 

wor-  r-  k(i‘—  I;  i  I / i ;/  \--z/k 

MSl™1  6  B{\/  2,u A 

where  B(  ,  }  is  the  Beta  function  [l6\  For  this  source,  the  magnitude 

error  term  needed  for  the  spherical  coordinates  quantizer  MSE  can  be 

found  to  be 


F  -  (^~1)  B2\{k- t-2)/6,(i/-l)/3~ 
r  2AB{k/2,u] 

The  spherical  MSE  rate  is  found  from  Eq.(12)  and  this  term  The  minimal 
MSE  rate  can  be  computed  to  be 

1(k+Z)/fc 


USE,***  C(k,2)  27t(y-l) 


r 

fc(u-l) 

fc+2 

r 

k  ( k  +  2u) 

2(k+2) 

N 


-Z/k 


These  Pearson  sources  have  restrictions  on  the  value  of  the  parame- 
ter  v  in  order  to  assure  unit  power  marginals  [  18  Plots  and  tables  of  the 
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coefficient  of  the  MSE  rate  versus  dimension  for  the  Pearson  VII  source 
with  various  values  of  the  parameter  u  are  presented  in  Figs  7  through  9 
arid  Tables  III  through  V.  The  greatest  performance  gams  by  the  spheri¬ 
cal  quantizers  were  for  those  Pearson  VTI  sources  which  are  furthest  from 
the  Gaussian  (u  approaches  unity).  These  sources  are  more  peaked  at  the 
origin  and  heavier  tailed.  Figure  10  compares  the  marginal  densities  of 
the  considered  sources  to  illustrate  this  point.  Note  that  as  the 

Pearson  VII  source  approaches  the  Gaussian  source. 


L.»X«] 


HU 

Sph. 

MSE 

Lower 

MSE 

Optimum 

MSE 

Upper 
MSE  i 

2 

20.432 

13.259 

10.078 

1 

3 

20432 

8.205 

5.3786 

5.4857 

8.0925 

4 

20.432 

6.4407 

3.8657 

3.9468 

5.1389  ' 

5 

20.432 

5.5567 

3.1357 

3.2246 

3.8951  | 

6 

20  432 

5.0265 

2.7089 

2.7838 

3.2253  f 

7 

20.432 

4.6723 

2.4293 

2.4941 

2.8102  ' 

8 

20.432 

4.4184 

2.2318 

2.2713 

2.5287 

9 

20.432 

4.227 

2.0848 

2.2423 

2.3253 

10 

20.432 

4.0772 

1.9709 

2.1305 

2.1716 

11 

20.432 

3.9565 

1.88 

2.0512 

12 

20.432 

3.8572 

1.8058 

1.9544 

13 

20.432 

3.7738 

1.7438 

1.8748 

14 

20  432 

3.7027 

1.6914 

1.8082 

15 

20.432 

3.6414 

1.6463 

1.7516 

16 

20432 

3.5878 

1.6072 

1.7028 

17 

20.432 

3.5407 

1.5729 

1.6604 

18 

20.432 

3.4988 

1.5426 

1.6231 

19 

20.432 

3.4614 

1.5155 

1.59 

20 

20  432 

3.4276 

1.4912 

1.5606 

21 

20  432 

3.3971 

1.4693 

1.5341  ' 

22 

20  432 

3.3693 

1.4494 

1.5102 

23 

20.432 

3.3439 

1.4313 

1  4884 

24 

20.432 

3.3205 

1  4147 

1  4686 

25 

20  432 

3.299 

1.3994 _ 

Table  III  -  Asymptotic  results  for  a  Pearson  MI  source,  v- 1.25 


Lower  j  Optimum  I  Upper 


9.3044 
9  3044 

9.3044 

3.3044 

9.3044 
9  3044 

9.3044 
9  3044 
9  3044 

9.3044 
9  3044 

9.3044 

9.3044 

9.3044 

9.3044 

9.3044 

9.3044 

9.3044 

9.3044 

9.3044 

9.3044 

9.3044 

9.3044 


4.2193 

3.7081 

3.4921 

3.3719 

3.2941 

3.2385 

3.1962 

3.1626 

3.1349 

3.1116 

3.0915 

3.074 

3.0505 

3.0446 

3.0321 

3.0208 

3.0105 

3.001 

2.9923 

2  9042 

2  9^67 

2  9697 

2.9631 


2.5478 
2.1075 
1.977 
1.8372 
1.7367 
1.6606 
1.6005 
1.5518 
1.5114  1 
1  4772 
1  4479  ‘ 
1.4224  | 
1.4001 
1.3802 
1.3625  ■ 
1.3466  ! 
1.3322  ! 
1.3191  : 
1.3071  j 
1  296 
1.2659 
1.2765 


3.3594 
2.5986 
2.2334 
2.0330 
1.8880 
1.7831 
1.6899 
1  7215 
1.6775 


3.8334  1 
2.9079  ; 
2.4557 
2.1874 
2.0091 
1.8814 
1.7B52  ! 
1  7098 
1.649  ! 
1.5989 
1.5567 
1.5207 
1.4895  ' 
1  4623 
1.4383  ; 
1  4169  ' 
1.3977  , 
1.3804 
1.3647 
1.3504 
|  1  3372 
1  3252 


Table  IV  -  Asymptotic  results  for  a  Pearson  VII  source,  v-2  5 
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Sph. 

MSE 

Lower 

MSE 

Optimum 

MSE 

Upper 

MSE 

2 

3 

4.1038 

4.1038 

3  1136 
2.9606 

2  0677 

2.5196 

2  1089 

3  111 

4 

4.1038 

2.9099 

1.8502 

1.889 

2  4595 

5 

4  1038 

2.8804 

1  7164 

1.7651 

2  1321 

6 

4.1038 

2.8776 

1.6246 

1.6695 

1  9343 

7 

4  1038 

2  8714 

1.5569 

1.5985 

1.8011 

8 

4.1038 

2.8672 

1.5047 

1.5314 

1  7049 

9 

4.1038 

2.864 

1.463 

1.5735 

1.6318 

10 

4.1038 

2.8614 

1.4287 

1  5444 

1.5741 

11 

4.1030 

2  859 

1.3999 

1.5274 

12 

4  1038 

2  0568 

1.3754 

1.4006 

13 

4.1038 

2.8548 

1.3542 

1.4559 

14 

4.1030 

2.8528 

1.3356 

1.4279 

15 

4  1038 

2.8509 

1.3192 

1.4035 

16 

4.1038 

2.049 

1.3C46 

1.3821 

17 

4.1038 

2.8471 

1.2914 

1.3632 

18 

4.1038 

2  8453 

1  2796 

1.3463 

19 

4.1038 

2.0436 

1.2688 

1.3311 

20 

4.1038 

2.0419 

1.2589 

1.3174 

21 

4.1038 

2.8402 

1  2498 

1.3049 

22 

4.1038 

2.8386 

1.2415 

1.2935 

23 

4.1038 

2.837 

1.2338 

1.283 

24 

4.1038 

2.8354 

1.2266 

1.2734 

25 

4.1038 

2.8339 

1.2199 

.  — 

1.2645 

Table  V  -  Asymptotic  results  for  a  Pearson  MI  source,  y=5 
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CONCLUSIONS 

This  chapter  presents  the  generalization  of  polar  quantizers  to 
greater  tnan  two  dimensions  for  all  spherically  symmetric  densities.  In 
comparison,  the  spherical  scheme  is  applicable  to  any  number  of  dimen¬ 
sions,  k ,  and  has  a  scalar  processor  implementation  while  the  optimal 
quantizers  are  available  only  when  the  k -dimensional  uniform  quantizer 
can  be  implemented.  The  derived  performance  expressions  may  be  used 
to  decide  if  spherical  schemes  are  of  value  in  the  particular  application 

The  MSE  rates  for  k^ 4  presented  were  for  large  values  of  A’  only 
Research  in  one-dimensional  compandor  approximations  suggest  that 
these  error  rates  are  also  valid  for  reasonable  data  rates  (i.e.  greater 
that  5  bits  per  dimension)  and  this  was  observed  in  the  examples  of  the 
three  dimensional  Gaussian  quantizers  computed  for  A'e[83,183].  It  was 
also  seen  for  the  Gaussian  source,  as  was  noted  in  the  published  polar 
results,  that  rectangular  quantizers  perform  better  than  spherical  quan¬ 
tizers  for  the  small  values  of  N  while  as  A’  increases,  the  asymptotic 
rates  became  valid  and  the  three-dimensional  quantizers  performed  best 
Of  course,  the  optimal  rate  is  always  lower 

The  results  presented  for  the  multidimensional  spherical  quantizers 
show  that  spherical  coordinates  encoding  of  spherically  symmetric 
sources  is  often  more  efficient  in  a  MSE  sense  than  one-dimensional  rec¬ 
tangular  coordinates  quantizing  For  the  Pearson  VT1  source  with  i/=l  25, 
polar  quantizing  (fc  =2)  has  a  gain  of  19  dB  in  Signal  to  Noise  Ratio  (SNR) 
over  rectangular  quantization  while  spherical  quantization  in  six  dimen¬ 
sions  showed  an  increase  of  6  dB  The  optimal  rate  for  k=6  is  approxi- 
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mate  ly  9  dB  over  the  rectangular  rate.  An  intuitive  explanation  for  the 
spherical  coordinate  superiority  over  rectangular  schemes  is  that  they 
preserve  the  spherical  symmetry  inherent  in  the  considered  multidimen¬ 
sional  densities. 

A  straightforward  and  perhaps  important  extension  of  this  work  is 
the  design  of  fc -dimensional  spherical  quantizers  with  uniform  step-size 
The  solution  set  is  then  only  the  factorization  of  N  and  the  magnitude 
quantizer  step-size  (k  parameters)  This  extension  is  important  because 
of  the  simplicity  of  its  implementation. 
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APPENDCX  A  -  BOUNDING  Mk_j 

The  term  .  defined  in  Eq  (4),  is  bounded  as  follows: 

1-  Given  that  then  M3 <  1 

Eq  (A)  expresses  as  the  expectation  over  <p3 e[-n/  2.7t/  2]  of  the 
function 


'['(i f:)  ~  sin?,  sin-pj  +  J/j^cosipj  eos?; 
where  <fi}  is  the  quantized  value  of  <p3  Hence,  upper  bounding  by 

unity  also  bounds  M}  by  unity  The  maximum  of  'i'(rj')  is 

1i,rnai=sm^J/ sin^j  which  is  attained  at  the  point  tan?_,  =Ai;_]tan?;  Since 

tan?;  <  tan?.,  ?j  -»  1  sin?.,  <  sin?;  -*  'Iv.ax-1-  -*  M:  ^  1 

2-  Given  that  and  the  ?.,  quantizer  satisfies  Eqs  (S';  and  (9). 

then  \’}>3 

The  form  of  Mj  in  Eq  (4)  involves  cosine  integrals  and  sine-cosine 
integrals  Rearranging  Eq  (9)  allows  substitution  and  expansion  of  the 
sine-cosine  integrals  over  p  in  Eq.(4)  The  result  is 


«... 


Mi  =  |{|  V^'n/'ygT '  ^;-i  l!  f  (sin2-dt  seci?,  +  cos'i?,cos?.,'!eosJ  \3  d?; 

1  U/  t-n  \j  f  <-/  i  =  i 

Since  all  of  the  terms  present  are  non-negative  over  the  range  of  ? , 


Af;>0 

3-  0<  Mj  <  1,  ;  =  2,3,  fc-1 


Since  A/]  =  sm(TT/ A’])  -  (tt/ ATj)  and  A';>1,  then  A/,r[0,l  This  fact, 
combined  with  1  and  2  inductively,  shows  that  .7=2,3.  fc-1 
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APPENDIX  B  -  SUFFICIENCY  OF  CONDITIONS 

In  the  text  of  this  chapter,  necessary  conditions  on  the  output  points 
(the  st)  and  the  breakpoints  (the  s,)  of  the  magnitude  and  angle  quantiz¬ 
ers  are  given  in  Eqs  (5)  and  (6)  and  Eqs.(8)  and  (9)  respectively.  The  pur¬ 
pose  of  this  appendix  is  to  demonstrate  the  sufficiency  of  these  condi¬ 
tions  The  included  analysis  closely  follows  that  of  Fleischer  [14]  and  will 
draw  several  results  from  his  paper 

For  the  magnitude  quantizer,  we  desire  to  minimize  D  in  Eq.(2)  and 
for  the  ji-th  angle  quantizer,  we  seek  to  minimize  —  M}  from  Eq.(4) 
(equivalent  to  maximizing  M) ) .  The  following  will  be  a  parallel  develope- 
ment  of  sufficient  conditions  for  either  type  (magnitude  or  angle)  quan¬ 
tizer  Sufficiency  is  shown  by  determining  that  the  matrix  of  second  par¬ 
tial  derivatives,  evaluated  at  the  stationary  point,  is  positive  definite 

From  Eqs  (2)  and  (4),  the  functionals  are  both  functions  of  2A'S  vari¬ 
ables  To  reduce  this  number,  assume  that  the  s,  are  preassigned  and 
optimize  over  the  s,  Taking  derivatives  yields 

~-=  /*(»*,)  (  -  rx  )  (  f,_,  +  f t  -  2A4_,rt  ) 

drx 

and 


a(-M,) 

db, 


=  Ajcos7-1!?!  f  sim?,  (  sini?,  -  sim?,.,  )  +  Af,_,  cost?,  (  cost?!  -  cost?,.,  ) 


where  K}  is  the  constant  term  from  Eq  (4).  Equating  these  expressions  to 
zero  yields  the  necessary  conditions  in  Eqs  (5)  and  (8)  respectively  In 
both  cases,  the  matrix  of  second  partial  derivatives  with  respect  to  the 
s, ,  evaluated  at  the  stationary  point  determined  be  Eqs  (5)  and  (8).  is  a 


| 
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diagonal  matrix  with  elements 


anc 


d2P 

(drj2 


■=  2 Mk-i  fk{rx)  (  f. 


r,_, 


/ 


— — ~^~=  K,  cos'  2t?,  (  simS,  -  sinfl,.,  ) 

(di?,)2  3 

Since  Mk _j  is  positive  and  the  s,  are  increasing  in  i,  the  above  matrices 
Eire  both  easily  seen  to  be  positive  definite.  The  result  is  that  for  fixed  s,, 
Eqs  (5)  and  (8)  are  necessary  and  sufficient  to  minimize  D  and  —M, 
respectively. 

Now  assume  that  for  the  quantizers,  the  breakpoints  are  assigned  as 
above  The  functional  is  now  dependent  only  on  A',  variables,  the  s,  Tak¬ 
ing  derivatives  and  using  the  conditions  of  Eqs  (o'  and  (8)  yield 


n*i 

jS~~  2  /  (  f,  -  )  fk(r)  dr 

or  i  r, 

and 

d(-Mj)  ^ 

— -r^r1 — -  J  (  cost?  sim?,  -  sim?  cost?,  )  K,  cos;  jt?  o!t? 
dT?,  ^ 

Again,  equating  to  zero  yields  the  necessary  conditions  in  Eqs. (6)  and  (9). 
After  careful  algebra  and  utilization  of  the  conditions  in  Eqs. (5),  \6),  (8) 
and  (9),  the  second  partial  derivative  matrix  with  respect  to  the  s,  can 
be  shown  to  be  of  the  form 


2a] -6,  &i  0  0 

—6,  2a2-6]-b2  -6 2  0 

0  —  b  j  2a3-fc2-6  3  — fc  3 

0  0  -63 


1 

0  I 


t 


2  a  a  ,  ~b,v,. 


0 
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where  for  the  D  minimization 


a,  =  f  fk(r)dr  and  6,  = 
n 

and  for  the  —Mj  case 


fk(T) 

2  M 


(  9 1  ~  ^«-i  ) 


o»  = 


Ki 


f  (  simS  sini},  +  M}^}  cost?  cost},  )  cos7-2"!?  di3 


*t 


and 


(  1  -  siir§,  sim},^,  -  cost},  cost},.. 


\2 


(  sim},  -  sLm},_j 


\3 


6,  =  Kj  Mf~ j  cos7  +2r}, 

Note  that  both  sets  of  6,  are  positive. 

For  a  matrix  M  of  the  above  form,  a  quadratic  form  can  be  expanded 
as 

xrMx  =  V  z,2  (  2a,  -  26,  -  26, )  +  £  6,  (  x,  +  1  -  x,  )2 

i=i  i=i 

where  60=0.  Since  the  6,  are  all  positive,  a  sufficient  condition  for  the 
quadratic  form  to  be  positive  and  the  matrix  to  be  positive  definite  is  that 


a,  =  2a,  -  26,  -  26, >  0 

For  the  minimization  of  D,  directly  following  Fleischer's  arguments 
from  this  point  yields  the  same  sufficient  condition 

|4 ~'ogfk(r)<0 
dr * 

This  condition  holds  for  all  of  the  densities  considered  in  the  examples 
As  to  the  maximization  of  Mj,  no  argument  similar  to  Fleischer's  is 
apparent  due  to  the  complexity  of  the  a,  and  6,;  hence,  a  numerical 
evaluation  of  the  cr,  for  the  resulting  quantizer  is  appropriate. 


APPENDIX  C  -  ASYMPTOTIC  DERIVATIONS 


In  our  previous  discussion,  we  saw  that  the  Mj  terms  were  defined 
sequentially  by 


and  for  2  ^  j  ^  k  - 1  by 


= 


sin(rr/  A'j) 
(7T/Arj) 


Ah  = 


ill 


•K/Z 


f  (  sin  <p  sin  tp  +  A/y_jCos  tp  cos  tp  )  cos^-1  tp  dtp  (Al) 


ir/2 


When  the  number  of  levels  is  each  quantizer,  Ay,  is  large,  the  com¬ 
pandor  model  approach  is  appropriate.  Using  this  model,  the  quantized 
output  is  approximately  equal  to  the  input  plus  a  random  error 


$  w  tp  +  c 


rq/2^  rf(7+gy  6~ 


r[(j  +5)/  6",  cos  ^~])/3tp 
where  c  is  uniformly  distributed  on  [-1/ 2Ay  ,  1/ 2  Ay  j.  Substituting  in  for 

p  in  Eq.(Al),  applying  the  trigonometric  identities 


sin  (a+p)  =  sin  a  cos  ft  +  sin  p  cos  a 
cos  {a+p)  =  sin  a  sin  p  +  cos  a  cos  p 
using  the  small  angle  approximations 

cos  7^1  —  ,  sin  7^7  — 

2  6 

integrating  over  c  and  simplifying  yields  (2  <  j  <  fc-l): 


a  LLULllL-  tt  H (j  +  1)/  2}  r3f(.7  +2)/6~  3  +  (;'  +2)  Mj.j 

J  +  l  24  (7+5)  r[j/2]  r3[(j+5)/6:  Nf 

Assume  that  Mj  is  of  the  form 
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This  holds  for  j  =  1  since 

M  _  sin(n/  ATi) 


»  1  - 


1 


C,  =  Zr- 


(tt/A’j)  6  A’f  ’*  6 

We  intend  to  show  that  this  expression  holds  inductively.  Substituting  for 

Mj-i  in  Eq.(A2)  yields 

M  ss  i  -  jSizlJf]  ft- .-2/0-D  _  (,+5)  T  0 fJ  + ; V 2.  I?L H± 2)/ g]  A: -2 
J  J  +  l  M  1  U  '  24rb/2]r3[(;+5)/6]  J 


+  TT  r[(;4-lV2]  r3[C?'f2)/6]  /  .t,'  c.  a--2  A  V-  -2/0-1) 

24  r[> /  2]  r®[ U  +5)/  6]  u  ;  J  1 1  1 


1=1 


Ignoring  the  last  term  (since  it  is  of  higher  power  of  N~})  and  maximizing 
over  the  value  of  ATj  shows  that  the  above  assumption  is  correct  and 
yields: 


c  .  i  t 
3  ~  j2  -  i  3 


where 


tt  r[(j  +  i  v  2i  r  3[  ( j  +2)/  e1  (jz-i) 


i/j 


24  T[j/Z]  r3[(;+5)/6]  j  ci- 1 
This  result  also  yields  the  solution  to  the  factorization  of  the  number 
of  levels  m  the  angle  quantizers' 


Nj  w 


JjL _ 

k-l 

n 

i=j>l 


A: 


l/(fc-J) 

SL 


Table  VI  presents  some  useful  precomputed  results  for  the  factorization 
of  The  above  expression  for  Nj  requires  the  computation  of  k- 1 
values  of  T}  and  is  different  for  each  k.  Instead,  we  present  values  of  F} , 
a  sequential  factorization  value  It  is  defined  as  the  proportion  of  the 
unused  angle  levels  which  should  be  assigned  to  the  j-th  angle  quantizer 


“  v-r 


■ 


Table  V]  -  Sequential  factorization  values  for  a  spherical  source 
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The  sequential  process,  beginning  with  quantizer  {?*- j.  is  as  follows 


x. 


-84- 


REFERENCES 

I.  J.  Max,  "Quantizing  for  Minimum  Distortion,"  IRE  Trans.  Inform. 
Theory,  Vol.  IT-6,  March  1960,  pp.7-12. 

2  J.J.Y.  Huang  &  P.M.  Schultheiss,  ,rBlock  Quantization  of  Correlated 
Gaussian  Random  Variables,"  IEEE  Trans.  Comm.  Sys,  Vol.  CS-11, 
Sept.  1963,  pp. 289-296. 

3.  P.  Zador,  Development  and  Evaluation  of  Procedures  for  Quantizing 
Multivariate  Distributions,  Stanford  Univ.  Dissert.,  Stat.  Dept.,  Dec. 
1963. 

4.  A.  Gersho,  "Asymptotically  Optimal  Block  Quantizers,"  IEEE  Trans. 
Inform  Theory,  Vol.  IT-25,  July  1979,  pp. 373-380. 

5.  J.H.  Conway  &  N.J.A.  Sloane,  "Voronoi  Regions  of  Lattices,  Second 
Moments  of  Polytopes  and  Quantization,"  IEEE  Trans  Inform 
Theory,  Vol.  IT-28,  March  1982,  pp. 21 1-226. 

6.  W. A  Pearlman,  "Polar  Quantization  Df  a  Complex  Gaussian  Random 
Variable,"  IEEE  Trans.  Comm.,  Vol.  COM-27,  June  1979,  pp. 892-899 

7.  J.A.  Bucklew  and  N.C.  Gallagher  Jr.,  "Quantization  Schemes  for  Bivari¬ 
ate  Gaussian  Random  Variables,"  IEEE  Trans  Inform.  Theory,  Vol 
IT-25,  Sept.  1979,  pp. 537-543. 

8.  J.A.  Bucklew  and  N.C  Gallagher  Jr.,  'Two-Dimensional  Quantization  of 
Bivariate  Circularly  Symmetric  Densities,"  IEEE  Trans  Inform 
Theory,  Vol.  IT-25,  Nov  1979,  pp.667-671 

9  S.G.  Wilson,  "Magnitude /Phase  Quantization  of  Independent  Gaussian 
Variates,"  IEEE  Trans  Comm.,  Vol.  COM-28,  Nov.  1980,  pp  1924-1929 

10.  P.F.  Swaszek  &  J.B.  Thomas,  "Optimal  Circularly  Symmetric  Quantiz¬ 
ers,"  to  appear  in  The  Journal  of  the  Franklin  Institute  or  Chapter  4 
of  this  dissertation. 

II.  R.D.  Lord,  "The  Use  of  the  Hankel  Transform  in  Statistics,"  Biome- 
trika,  Vol.  41,  June  1954,  pp  44-55. 

12  M  Kendall,  The  Geometry  of  n  Dimensions,  Griffin  Co  Ltd  ,  London. 
1962. 

13.  W  R.  Bennett,  "Spectra  of  Quantized  Signals,"  Bell  System  Tech 
Jour.,  Jul>  1948,  pp  446-472. 

14.  P.E  Fleischer,  "Sufficient  Conditions  for  Achieving  Minimum  Distor¬ 
tion  in  a  Quantizer,"  IEEE  Int  'I  Conv  Rec.,  1964,  part  1,  pp  104-111 

15.  R.  Weinstock,  Cblcvlus  of  Variations,  McGraw-Hill,  N  Y. ,  1952. 

16  H  Abramowitz  and  I. A  Stegun,  Handbook  of  Mathematical  Func¬ 
tions,  National  Bureau  of  Standards  Applied  Mathematics  Series  #55, 
Dec  1972 

17.  V.R  Algazi,  "Useful  Approximations  to  Optimal  Quantization,"  IEEE 
Trans.  Comm.  Tech.,  Vol  COM-14,  June  1966,  pp  297-301. 

18.  D.K.  McGraw  &  J.F.  Wagner,  "EUiptically  Symmetric  Distributions," 
IEEE  Trans.  Inform  Theory,  Vol  IT-14,  Jan  1968,  pp  110-120 


-35- 


CHAPTER  4  -  OPTIMAL  CIRCULARLY  SYMMETRIC  QUANTIZERS 

INTRODUCTION 

The  canon'  al  example  of  an  zero-memory  or  one-dimensional  quan¬ 
tizer  is  Max's  Gaussian  probability  density  function  quantizer  [1]  for  the 
performance  criterion  Mean  Square  Error  (MSE).  The  MSE  criterion  has 
universal  appeal  in  its  tractability  and  its  intuitive  relationship  to  noise 
power,  hence  signal-to-noise  ratio  (SNR).  Rate  distortion  theory,  how¬ 
ever,  suggests  that  multidimensional  or  block  quantizers  may  be  more 
efficient  Research  interest  in  multidimensional  quantization  began  with 
the  work  of  Huang  and  Schultheiss  [2-  who  considered  the  problem  of 
quantizing  a  correlated  Gaussian  source  efficiently.  Their  solution  was  to 
uncorrelate  the  source  by  an  appropriate  linear  filter,  thereby  changing 
the  set  of  coordinates,  and  to  quantize  the  resulting  independent  Gaus¬ 
sian  random  variables  with  separate  Max-type  quantizers 

Zador  [3]  examined  the  more  general  problem  of  quantizing  a  mul¬ 
tidimensional  source  under  the  assumption  of  a  large  number  of  levels. 
He  employed  Bennett's  compandor  model  and  derived  error  rates 
depending  upon  the  compressor  function  and  uniform  quantizer  used 
His  expressions  showed  that  the  problem  of  optimal  quantization  could  be 
divided  into  two  separate  problems:  finding  the  best  compressor  function 
on  the  multidimensional  input  space  and  implementing  the  optimal  mul¬ 
tidimensional  uniform  quantizer  on  the  unit  hypercube  In  two  dimen¬ 
sions,  the  optimal  uniform  quantizer  is  a  honeycomb-like  tessellation  of 
hexagons  When  mapped  by  the  inverse  of  the  compandor  function,  the 


~  *~r  r  -  *  - 

i aim 
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quantizer  becomes  a  pattern  of  distorted  hexagons  on  the  plane  [4’. 

Another  major  area  of  interest  in  multidimensional  quantizer  design 
rests  in  the  use  of  polar  coordinates  for  the  independent,  bivariate  case 
Specifically,  rather  than  separately  quantizing  the  abscissa  and  ordinate 
as  in  Fig.  1,  a  change  of  variables  to  polar  coordinates  is  effected.  The 
resulting  magnitude  and  phase  are  quantized  separately  by  "eal-time 
one-dimensional  quantizers.  Of  particular  interest  is  the  quantizing  of 
independent,  bivariate  Gaussian  random  variables  with  density 

p(x.y)  =  ^ ~  e-^vV2 

CTT 

For  example  DFT  coefficients,  holographic  data  or  pairs  of  inputs  from  an 
iid  Gaussian  source  can  be  considered  as  the  output  of  a  bivariate  Gaus¬ 
sian  source 

Independent,  unit-power  Gaussian  variates  in  rectangular  coordi¬ 
nates  transform  to  independent  magnitude  and  phase  on  the  polar  coor¬ 
dinates  plane  by  the  transformations 

t  =  Vz2+y2  ;  <p  =  tan-3  — 

X 

The  resulting  source  density  expressed  as  a  function  of  the  polar  coordi¬ 
nates  is 

=  ~r  e  ~ri/z 

The  magnitude  r  is  Rayleigh  distributed  on  [0,°°)  and  the  phase  <p  is  uni¬ 
formly  distributed  on  [0,27t).  Minimizing  MSE  results  in  a  uniform  quan¬ 
tizer  for  the  phase  angle  and  a  scaled  Max-type  Rayleigh  quantizer  for  the 
magnitude  It  has  been  shown  [5,6]  that  polar  coordinates  quantizers  for 
a  bivariate  Gaussian  source  almost  always  have  smaller  MSE  than 


t. 
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rectanguiar  quantizers 

This  chapter  examines  the  optimality  of  the  polar  quantizers 
developed  by  Pearlman  [5]  and  Bucklew  and  Gallagher  [6]  for  the  MSE 
criterion  It  is  well  known  [4]  that  two  conditions  are  necessary  for  a 
Local  minimum  of  MSE  [7,8]:  centroidal  output  points  and  Dirichlet  parti¬ 
tion  boundaries.  Polar  quantizers  do  not  conform  to  these  conditions 
Permutations  which  do  conform  (labeled  Dirichlet  polar  quantizers)  will 
be  developed  and  compared  to  other  available  two-dimensional  quantiza¬ 
tion  schemes.  Wiison's  technique  [9]  will  be  mentioned  and  considered  as 
an  input  for  the  Dirichlet  form.  Although  this  chapter  will  pursue  in 
depth  only  the  bivariate  Gaussian  case,  the  extensions  to  higher  dimen¬ 
sions  [10]  and  other  circularly  symmetric  densities  [llj  will  be  outlined 


OPTIMAL  TWO-DIMENSIONAL  QUANTIZERS 

Define  the  minimum  MSE,  N-level  quantizer  Q\  on  the  plane  by 
[Sl,xl;i  =  l,2,...,A’[  where  the  Sl  are  disjoint  regions  such  that  their  union 
covers  the  plane  and  the  Xj  are  the  output  points  associated  by  the  quan¬ 
tizer  to  these  regions.  The  quantizer’s  operation  for  the  mput  vector  x  is 

Qy(x)  -  x,  ;  sc  S, 

For  an  input  x  with  bivariate  pdf  p(x),  the  MSE  D  is 


D  =  /  /  |x  -  Qs{x)  2p(x)cfx 

-  —  —OB 

Minimizing  D  over  the  choice  of  5,  and  x, ,  the  following  are  necessary 
conditions 


xp(x)dx 
f  f  p{x)dx 


(1) 


i 
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which  states  that  the  output  %  is  the  centroid  of  the  region  Sl  with  den¬ 
sity  p  (x)  and 

N 

Si  =  n  (x :  |x-  %  <  x-  Xj  ,  $  (2) 

which  states  that  5!  is  formed  by  te\  :  the  intersection  of  nearest 
neighbor  or  Dirichlet  partitions  of  x*  and  thr  ;her  output  points  The 
points  of  equality  in  Eq.(2l  are  the  region  boundaries  which  are  assigned 
to  either  region  and  contribute  equivalent  error  either  way.  A  Dirichlet 
partition  is  the  perpendicular  bisecter  of  the  line  segment  connecting  a 
pair  of  output  points  From  Eq.(2),  it  can  be  shown  that  the  resulting  5, 
are  all  convex,  simply  connected  regions  This  partitioning  holds  for  most 
mean  error  measures  while  centroidal  outputs  holds  only  for  MSE  The 
resulting  MSE  for  this  optimal  quantizer  is 

D-al-Y.  2  //p(x)dx 

i  =  l  5, 

where  is  the  signaJ  power 

For  the  uniform  density  on  the  unit  square,  the  optimal  region  pat¬ 
tern  for  fine  quantization,  ignoring  edge  effects,  is  known  to  be  a  tessella¬ 
tion  of  regular  hexagons  For  other  densities,  Eqs  (1)  and  (2)  may  be 
used  iteratively  to  converge  to  a  local  minimum  of  MSE.  Note  that  if  the 
regions  are  fixed,  Eq.(l)  is  necessary  and  sufficient  to  minimize  D.  When 
the  output  points  are  fixed,  Eq  (2)  is  necessary  and  sufficient  to  minimize 
D.  The  iterative  design  method,  as  previously  proposed  for  one¬ 
dimensional  problem  solutions  [12],  is  to  select  a  set  of  outputs  fx,{  and 
to  employ  Eq  (2)  to  select  the  5,  optimally  This  set  of  outputs  and 
regions  has  a  distortion  measure  Pj  Usually,  Eq  (1)  is  not  satisfied,  the 
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jxj  not  being  optimal  for  the  generated  regions,  so  redefining  the  out¬ 
puts  by  Eq.(l)  will  decrease  D  to  a  value  smaller  than  D j,  say  Dz.  Simi¬ 
larly,  now  Eq.(2;  is  probably  not  satisfied,  so  redefining  the  regions  will 
again  decrease  the  error.  This  iterative  scheme  converges  to  a  local 
minimum  of  D  due  to  the  fact  that  D  is  reduced  by  each  application  of 
Eq.(l)  or  (2)  and  that  D  is  lower  bounded  by  zero  by  being  the  integral  of 
a  positive  quantity. 

DIRICHLET  POLAR  QUANTIZERS 

■Wilson  [9]  classified  two  types  of  polar  quantizers:  Strictly  Polar 
(SPQ)  and  Unrestricted  Polar  (UPQ)  Quantizers.  For  the  SPQ's,  the  total 
number  of  outputs  N  is  factored  into  Nr*N9,  the  number  of  magnitude 
and  phase  levels  respectively  The  UPQ’s,  a  larger  class  of  quantizers, 
require  only  that  the  number  of  outputs  sum  up  to  N  (P:+P2+  ...PU  =  N), 
hence  different  radii  levels  can  have  .  iferent  numbers  of  phase  levels 
For  small  N,  UPQ’s  have  been  shown  to  substantially  reduce  the  MSE.  All 
polar  quantization  regions  are  partial  annuli,  delimited  by  rays  of  con¬ 
stant  angle  and  arcs  of  constant  radius  as  in  Fig.  2.  Unfortunately,  these 
quant'zers  do  not  satisfy  Eqs(l)  and  (2).  In  particular,  the  magnitude 
boundaries  are  not  Dirichlet  partitions.  From  Eq  (2),  each  is  a  convex 
polygon  which  partial  annuli  are  not. 

The  iterative  technique,  as  explained  above  using  Eqs.(l)  and  (2), 
may  be  employed  to  the  strictly  polar  quantizers  to  reduce  MSE  and  con¬ 
verge  to  a  local  minimum.  After  selecting  a  factorization  of  AT=A'r*A'f, 
applying  Eq.(2)  yields  a  pattern  as  in  Fig  3  The  inherent  symmetry  of 
this  pattern  allows  the  analysis  to  focus  on  one  slice  of  angle  2tt/ A  ?  The 
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iter  at  ive  use  of  Eqs  (1)  and  (2)  will  not  change  the  phase  boundaries;  only 
the  magnitude  boundaries  will  move.  Similarly,  the  output  points  will 
vary  along  the  ray  bisecting  the  phase  boundaries.  Hence,  a  one¬ 
dimensional  iteration  will  yield  these  Dirichlet  Polar  Quantizers  (DPQ’s) 
from  the  SPQ's.  Dallas  [13]  has  applied  a  similar  region  shape  to  the 
reduction  of  the  Fourier  domain  phase  quantization  noise  for  computer 
generated  holograms. 

From  Fig  3,  it  is  seen  that  the  DPQ’s  can  be  implemented  as  follows. 
First,  quantize  the  phase  to  one  of  levels  with  a  uniform  quantizer  on 
[0,2tt).  The  second  coordinate  used  to  specify  the  output  is  its  distance  s 
along  the  quantized  phase  ray 

s  =  r  cos(^  —  $) 

for  Ip  the  quantized  version  of  <p.  The  univariate  probability  distribution 
function  of  this  distance  coordinate  can  be  found  to  be 

/(s)  =  e~*t/g  |<i>(s  tan  n/ N^)  -  .5 
for  $  the  error  function  integral 

Letting  ATf-»«=  (with  I'Hopital's  rule),  /(s)  approaches  the  Rayleigh  den¬ 
sity. 

Standard  Max-type  expressions  may  be  used  to  define  the  minimum 
MSE,  Nr -level  quantizer  for  s 

f  s  f{s)  ds 

± _ 

•i-*  j 

f  f(s)ds 
*< 


_  .  St-l+St 

Si - 5 - 


;  s,  = 
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where  the  st  are  the  quantizer  outputs  and  the  st  are  the  region  end¬ 
points.  Uniqueness  of  this  quantizer  is  shown  by  applying  Fleischer’s  con¬ 
dition  [  12]  to  the  distance  density 

log  /  (s)  <  0 

Wilson’s  solutions  of  the  UPQ’s  for  N=1 . 32  may  also  be  considered 

with  the  iterative  technique.  His  N  =  1,  2,  3  and  4  cases  are  already 
optimum.  The  N  =  5,  6,  7  and  8  solutions  are  easily  extended.  Unfor¬ 
tunately,  for  N  >  8,  the  boundaries  are  no  longer  easy  to  compute  and  the 
resulting  analysis  is  not  included  here.  He  only  considered  small  N  since 
the  number  of  factorizations  grows  quickly  with  N  and  because  the  small 
N  region  is  of  importance  since  it  is  here  that  rectangular  formats  out¬ 
perform  polar  forms. 

DIKICHLET  ROTATED  POLAR  QUANTIZERS 

The  previous  section  showed  that  Eqs.(l)  and  (2)  can  be  applied  to  a 
set  of  outputs  to  iterate  toward  a  local  minimum  of  MSE.  The  resulting 
quantizer  will  vary  depending  upon  the  initial  output  point  pattern.  A 
rectangular  starting  grid  produces  a  rectangular  quantizer,  a  pair  of  Max 
Gaussian  quantizers,  since  the  partitions  will  always  move  perpendicular 
to  themselves.  A  polar  initial  pattern  produces  the  Dirichlet  Polar  Quan¬ 
tizer  already  introduced. 

Consider  the  polar  quantizer  (SPQ)  where  the  magnitude  and  phase 
are  independently  quantized  (Fig.  2).  A  rotation  of  every  other  magni¬ 
tude  ring,  as  in  Fig.  4,  does  not  change  the  associated  MSE.  This  new  pat¬ 
tern,  when  applied  as  a  starting  point  for  the  iterative  method  with 


Fig.  4  -  Rotated  polar  pattern. 


Fig.  5  -  Dirichlet  Rotated  Polar  Quantizer  (DRPQ)  pattern 
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Eqs.(l)  and  (2).  will  yield  a  quantization  pattern  as  in  Fig.  5,  quite 
different  from  the  Dirichiet  Polar  Quantizer.  This  Dirichlet  Rotated  Polar 
Quantizer  (DRPQ),  although  more  difficult  to  implement  than  the  DPQ. 
has  lower  MSE  (for  a  possible  implementation,  see  Appendix  A). 

Other  rotations  and  permutations  on  the  plane  could  be  used  to  solve 
for  better  quantizers.  However,  most  other  patterns  make  Eq.  (1) 
difficult  to  compute.  A  further  extension  of  this  rotated  form  is  to  allow  a 
central  region  with  Nf  sides  and  output  value  zero  similar  to  Wilson’s  5 
through  8  patterns.  The  MSE  savings  could  be  dramatic,  but  are  not  con¬ 
sidered  here. 

EXAMPLES 

The  iterative  technique  is  defined  by  Eqs.(l)  and  (2).  The  numerical 
calculations  of  the  region  probabilities  and  moments  for  the  bivariate 
Gaussian  density  are  described  in  Appendix  B.  For  the  examples,  the  fol¬ 
lowing  factorizations  of  N  were  employed. 

Rectangular:  Nx  «  Ny 

Polar:  Np*2.6Nr 
DPQ.  Nf"2.6N, 

DRPQ:  Nf*Nr 

Symmetry  arguments  show  that  the  rectangular  MSE  is  minimized  if  the 
levels  are  equally  divided  among  the  coordinates.  Previously  published 
results  suggest  the  factorization  for  the  polar  scheme.  As  the  number  of 
levels  gets  large,  the  DPQ's  and  the  polar  quantizers  are  equivalent, 
hence  the  asymptotic  factorizations  of  N  are  the  same. 

For  the  tabulated  results,  all  factor  nations  for  the  DPQ's  were  com- 
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par  ed  and  the  best  result  occurred  concurrent  with  the  polar  factoriza¬ 
tion.  For  the  DRPQ’s,  all  combinations  were  attempted  for  Ns  144.  It  was 
seen  that  equal  division  of  the  levels  produced  optimal  results.  For 
N>144,  only  equal  factorizations  were  attempted;  hence,  the  actual  error 
rates  may  be  lower  than  the  tabulated  results  for  those  values  of  N.  The 
comparison  of  MSE  rates  is  in  Table  I  with  a  plot  of  the  results  in  Fig.  6. 
Error  values  for  polar  and  rectangular  quantizers  are  included  for  com¬ 
parison.  The  number  in  parenthesis  is  the  actual  number  of  levels  if 
different  from  the  first  column.  This  difference  appears  due  to  the  neces¬ 
sity  to  factor  N  into  appropriate  integers.  Figs.  7  through  13  depict  the 
DRPQ  patterns  for  some  of  the  values  listed  in  Table  I. 
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N 

Polar 

Dirichlet 

Polar 

Dirichlet 
Rotated  Polar 

— 71 

Rectangular 

16 

.2396 

.2391 

.2224 

.2350 

26 

.1710  (24) 

.1702  (24) 

.1462 

.1599 

36 

.1176 

.1174 

.1052 

.1159 

49 

.08889  (48) 

.08882  (48) 

.07899 

.08800 

94 

.06973 

.06967 

.06134 

.06908 

100 

.04392  (102) 

.04387  (102) 

.04003 

.04586 

144 

.03244  (140) 

.03241 (140) 

.02816 

.03268 

225 

.02056 

.02055 

£.01B22 

.02146 

324 

.01468  (320) 

.01467  (320) 

£.01280 

.01519 

529 

.008904(532) 

.008899(532) 

£.008046 

.009482 

ritfi 

1 1 1  m  m 

Table  1  *  Bivariate  Gaussian  density  quantizer's  14SE  values. 
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Fig.  6  -  Comparison  of  WSE  rates  for  four  bivariate  quantizers 
(Rectangular,  SPQ.  DPQ  and  DRPQ). 


Fife  9  -  N*36  DRPQ  pattern. 


Fig.  10  -  N=49  DRPQ  pattern. 


Fig.  11  -  N=64  DRPQ  pattern. 


Fig  12  -  N=100  DRPQ  pattern 
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Fig.  13  -  N=  144  DRPQ  pattern. 


CONCLUSIONS 


For  two  reasons,  the  presented  figures  are  dominated  by  patterns  for 
DRPQ’s.  The  DPQ  patterns  are  all  of  the  same  form  as  Fig.  3  and  the 
DPQ’s  MSE  is  only  slightly  below  that  of  the  SPQ.  being  equal  when  N -><*>. 
The  DRPQ  patterns  are  included  to  demonstrate  the  hexagonality  of  the 
quantization  regions,  the  way  in  which  the  hexagon  sizes  are  distributed 
and  because  the  DRPQ’s  substantially  reduce  MSE.  At  N=100,  the  gain  in 
SNR  is  .6  dB  over  rectangular  and  .4  dB  over  polar  quantizers. 

From  Fig.  6.  the  asymptotic  MSE  rates  can  be  considered.  The  SPQ 
and  DPQ  (equivalent  as  have  rate  AlxE>=4.95  for  a  bivariate  Gaus¬ 

sian  source.  The  corresponding  optimal  rate  is  4.03  and  the  rectangular 
rate  is  5.44.  From  the  graph,  the  DRPQ  rate  falls  between  the  polar  and 
optimum.  Although  the  DRPQ  is  not  optimal,  it  does  always  perform 
better  than  both  polar  and  rectangular  schemes.  Results  for  DRPQ's 
allowing  an  ATr-sided  polygonal  region  at  the  origin  may  be  even  better. 

Up  to  this  point,  this  chapter  considered  only  the  bivariate  Gaussian 
case.  The  trapezoids  of  the  Dirichlet  Polar  Quantizer  and  the  polygons  of 
the  DRPQ  become  polytopes  in  higher  dimensions.  Other  circularly  sym¬ 
metric  and  non-circularly  symmetric  densities  may  also  be  used.  The 
difficulty  in  both  cases  is  obtaining  accurate  probability  and  moment 
integrals. 

Polar  quantizers  as  described  in  the  literature  minimize  MSE  subject 
to  independent  coordinates.  Loosening  the  coordinate  selection  slightly 
(to  angle  <p  and  distance  s)  yields  DPQ  s,  again  minimizing  MSE  for  their 
constraint  class  Further  loosening  of  the  coordinate  class  yields  the 
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DRPQ’s  with  substantially  reduced  MSE,  but  increased  complexit}  of 
implementation.  The  Intuition  to  be  gained  from  this  work  is  as  follows 
all  of  the  mentioned  schemes  (rectangular,  polar,  DPQ  and  DRPQ,  minim¬ 
ize  MSE  subject  to  their  implementation  constraint.  Rectangular  formats 
retain  centroids  and  Dirichlet  partitions  (necessary  conditions),  but  lose 
the  symmetry  of  the  problem;  polar  forms  preserve  the  problem  sym¬ 
metry  but  lose  the  necessary  conditions;  the  DPQ  and  DRPQ  schemes 
have  both 
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APPENDIX  A  -  DRPQ  IMPLEMENTATION 

This  appendix  presents  a  possible  real-time  implementation  for  the 
Dirichlet  Rotated  Polar  Quantizers  (DRPQ’s).  For  an  N-level  quantizer, 
the  levels  factorization  is  N  =  Nr  x  Np.  The  scheme  is  as  follows: 

1  -  Convert  the  input  xto  polar  coordinates,  r  and  tp. 

2  -  Process  the  phase  angle  <p  with  a  2A,r-level  uniform  quantizer  on 
[0,2w).  The  outputs  $  are  of  the  form  Tr(2ifc  -1)/  2Nf  for  Jfce[l,2,...2A^]. 

3  -  Process  the  magnitude  r  with  a  AV -level,  lower  value  quantizer.  This 
quantizer's  output  f  is  the  magnitude  value  closest  and  less  than  the 
actual  distance. 

4  -  For  a  lower  magnitude  of  level  j  and  a  phase  of  level  k,  compare 

fj  e**kJ  -  r  eip  and  f;  +]  e**kj*'  —  r 
to  find  the  closest  output  where 

si  _  v  2fc  —  1  .  rr  +  if  !  is  even 

Vk]  Np  2  +  2N9  -if  |  j  -k  j  is  odd 

This  scheme  requires  no  compressor  functions  as  does  the  optimal 
scheme  and  is  real-time,  digital  implementational.  Also,  this  implemen¬ 
tation  extends  trivially  to  the  zero-output  extension  of  the  DRPQ  previ¬ 
ously  described. 


APPENDIX  B  -  BIVARIATE  GAUSSIAN  INTEGRALS 


The  numerical  calculations  necessary  to  solve  iteratively  Eqs.(l)  and 
(2)  for  the  DPQ's  and  DRPQ’s  involve  integrations  on  the  bivariate  Gaus¬ 
sian  plane  of  polygonal  regions.  Polygons  on  the  plane  can  be  partitioned 
into  the  sum  and  difference  of  triangles  which  have  a  vertex  at  the  origin 
and  a  side  along  a  coordinate  axis.  Without  loss  of  generality,  since  the 
regions  are  symmetric .  about  a  ray  of  constant  angle,  we  assume  the 
regions  to  be  symmetric  about  the  positive  x*axis  and  use  this  axis  as  the 
side  of  all  the  triangles  (see  Fig.  14). 

For  the  calculation  of  the  areas  (probabilities),  these  triangles  are 
again  partitioned  into  the  difference  of  two  right  triangles  with  a  vertex 
at  the  origin  as  in  Fig  15.  A  right  triangle  is  rotated  about  the  origin  to 
be  equivalent  to  one  with  vertices  (0,0),  (0 ,h.)  and  ( h,k )  as  in  Fig  16.  The 
area  is  then 


h  lac/ ft 

J  e-*e/z  f  e^t/zdydx 

o  0 

This  expression,  although  not  directly  integrable,  can  be  expanded  into  a 
series  summation  [14,15] 


V{h,k)  =  (Sn)”1 

’ 

+  i*5  1“ * 

o 


|Ml-e"m)  -  |*3(l-e-m— me 
-m  __  _  -m  _  m2  -m  _  . 


m) 


with  \-k/h  and  m  =%  hz.  Truncation  of  this  series  after  20  terms  yielded 
the  approximations  employed  in  the  presented  results. 

The  symmetry  of  the  DPQ  and  DRPQ  regions  reduces  the  moment  cal¬ 
culation  to  that  along  the  ray  of  symmetry  (the  x-axis).  For  the  original 


6 

Fig.  14  -  Triangular  region. 


c 
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Fig  15  >  Difference  of  right  triangles. 


16  -  Triangle  with  sides  of  length  h  and  k . 
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triangle  with  vertices  at  (0,0),  (c  ,0)  and  (6  ,a)  the  i  moment  is 


«»+!/« 

M  =  f  f  x  -~e  2  di  dy 

Ac*b  " 

Inserting  the  correct  limits  in  the  integration,  integrating  over  *,  com¬ 
pleting  the  square  in  y  in  the  exponent  and  integrating  over  y  yields 


u  = 

*SZng 


-  exp 


— ac 


2(c  -6  )hz 


ah  + 


(c  —b)h 


-  $ 


(c  —b)h 


and  h  =  ~\/ 14  — ■ 
V  (c  —6  )2 


where 
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CHAPTER  5  -  CONCLUSIONS 


REVIEW  AND  FURTHER  RESEARCH 

In  this  chapter,  the  main  achievements  of  each  of  the  preceding 
chapters  will  be  discussed.  Shortcomings  and  possible  avenues  of  future 
research  will  be  mentioned  when  available. 

In  the  second  chapter,  zero-memory  quantizers  are  designed  when 
the  available  source  statistical  description  is  a  histogram.  The  design  of 
the  histogram  measurement  is  also  discussed.  This  scheme  is  practical 
in  that  only  information  which  is  easy  to  obtain  is  needed  to  completely 
design  the  quantizer  and  the  piecewise  linear  compressor  is  easy  to 
implement.  Recently,  this  idea  has  been  extended  to  block  quantizers 
[1],  Further  research  in  robust  quantizer  design  might  iaclude  (i)  apply¬ 
ing  other  techniques  besides  Chebychev-like  probability  inequalities  to 
the  problem  of  allocating  the  histogram  regions,  (ii)  discussing  the  design 
inaccuracy  due  to  the  empirical  region  probability  measurements  and 
(iii)  in  block  quantization,  using  as  the  histogram  cell  a  cross  product  of 
intervals  and  exploring  this  form  of  dependence  structure 

The  third  chapter  considered  the  extension  of  polar  quantizers  to 
greater  than  two  dimensions.  The  general  result  for  k  -dimensions  and 
any  spherically  symmetric  source  were  presented  It  was  noted  in  the 
chapter  that  the  Gaussian  source  did  not  exhibit  an  appreciable  gain  in 
performance  on  allowing  the  number  of  dimensions  to  increase.  Among 
the  problems  which  remain  to  be  answered  are  the  following  (i)  can  other 
coordinate  systems  be  applied  as  easily  and  (ii)  how  often  do  spherically 
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symmetric  sources  occur  naturally'5  The  design  was  founded  firmly  upon 
the  fact  that  the  source  was  spherically  symmetric.  This  implies  a  cer¬ 
tain  dependence  structure  on  the  multivariate  density.  Rectangular 
quantizers,  although  not  performing  as  well  in  the  tabulated  examples, 
are  robust  in  the  sense  that  their  error  rate  is  independent  of  the  mul¬ 
tivariate  source  structure  since  only  the  marginal  density  matters.  This 
fact  suggests  that  when  the  multivariate  structure  is  questionable,  rec¬ 
tangular  quantizers  should  be  employed. 

The  fourth  chapter  extends  the  results  of  the  third  chapter  by  con¬ 
sidering  the  optimality  of  spherical  coordinates  quantizers.  Several  other 
authors  [2,3]  have  noted  the  lack  of  optimality  of  block  quantizers.  The 
chapter  stresses  the  facts  that  the  DRPQ's  have  hexagonal  regions,  which 
are  conjectured  to  be  optimal,  and  nearly  optimal  performance  Future 
research  in  this  area  could  be  (i)  extending  the  examples  to  other 
sources  beyond  the  bivariate  Gaussian  and  (ii)  allowing  a  central  region  in 
the  pattern  whose  output  value  is  zero 
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